-- Logs begin at Fri 2022-09-16 01:14:24 UTC, end at Fri 2022-09-16 02:09:56 UTC. -- Sep 16 01:39:15.178312 dv-cinder-849143-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 16 01:39:15.185478 dv-cinder-849143-2-smb devstack@keystone.service[81440]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 01:39:15 2022] *** Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: nodename: dv-cinder-849143-2-smb Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: machine: x86_64 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: clock source: unix Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: pcre jit disabled Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: detected number of CPU cores: 4 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: current working directory: / Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: detected binary path: /usr/bin/uwsgi-core Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: your processes number limit is 47680 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: your memory page size is 4096 bytes Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: detected max file descriptor number: 2048 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: lock engine: pthread robust mutexes Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: thunder lock: enabled Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 16 01:39:15.189711 dv-cinder-849143-2-smb devstack@keystone.service[81440]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 01:39:15.228440 dv-cinder-849143-2-smb devstack@keystone.service[81440]: Python main interpreter initialized at 0x5643341549c0 Sep 16 01:39:15.228440 dv-cinder-849143-2-smb devstack@keystone.service[81440]: python threads support enabled Sep 16 01:39:15.228440 dv-cinder-849143-2-smb devstack@keystone.service[81440]: your server socket listen backlog is limited to 100 connections Sep 16 01:39:15.228440 dv-cinder-849143-2-smb devstack@keystone.service[81440]: your mercy for graceful operations on workers is 90 seconds Sep 16 01:39:15.228798 dv-cinder-849143-2-smb devstack@keystone.service[81440]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 01:39:15.228887 dv-cinder-849143-2-smb devstack@keystone.service[81440]: *** Operational MODE: preforking *** Sep 16 01:39:15.229124 dv-cinder-849143-2-smb devstack@keystone.service[81440]: *** uWSGI is running in multiple interpreter mode *** Sep 16 01:39:15.229124 dv-cinder-849143-2-smb devstack@keystone.service[81440]: spawned uWSGI master process (pid: 81440) Sep 16 01:39:15.229344 dv-cinder-849143-2-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 16 01:39:15.231083 dv-cinder-849143-2-smb devstack@keystone.service[81440]: spawned uWSGI worker 1 (pid: 81453, cores: 1) Sep 16 01:39:15.231083 dv-cinder-849143-2-smb devstack@keystone.service[81440]: spawned uWSGI worker 2 (pid: 81454, cores: 1) Sep 16 01:39:15.231083 dv-cinder-849143-2-smb devstack@keystone.service[81440]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 01:39:19.503699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:39:19.503699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: from cryptography.utils import int_from_bytes Sep 16 01:39:19.504519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:39:19.504519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: from cryptography.utils import int_from_bytes Sep 16 01:39:19.504640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:39:19.504640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: from cryptography.utils import int_from_bytes Sep 16 01:39:19.505094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:39:19.505094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: from cryptography.utils import int_from_bytes Sep 16 01:39:19.554409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:39:19.554548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:39:19.554705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:39:19.554802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] command line args: [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:39:19.554902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:39:19.554988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:39:19.555099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] command line args: [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:39:19.555191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ================================================================================ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:39:19.555371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:39:19.555457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] admin_token = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.555560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ================================================================================ {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:39:19.555646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_dir = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.555783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.555867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] admin_token = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.555968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] config_source = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] config_dir = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] debug = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] config_source = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] debug = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.556956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.557948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_config_append = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_config_append = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_dir = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_dir = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_file = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.558985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.559952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.560990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.561841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] publish_errors = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.33/identity {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] publish_errors = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.562981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] standard_threads = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.563877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] standard_threads = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_journal = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_json = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] use_journal = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_stderr = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] use_json = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] use_syslog = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.564985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] use_stderr = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.565086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.565172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] use_syslog = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.565328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:39:19.565455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.565563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.565646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.565811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.565910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.566904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.567866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.568975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.569975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.570948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.571963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.572912 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.573841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.574949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.575933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.576852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.577954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.578890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.579927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.580954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.581939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.582021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.582182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.582263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.582927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.583946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.584886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.585995 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.586953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.587969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.588877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589483 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.589975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.590942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.external = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.external = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.591985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.password = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] auth.token = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.password = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] auth.token = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.592908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.593849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.594985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.595936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.596990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.597935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.598032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.598718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.598909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.598991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.599976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.600934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.601933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.602797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.603026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.603103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.604951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605675 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.605929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.606936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.607966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.608900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.609840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.610953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.611901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.612970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.613888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.614961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.615899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.616998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.617959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.618992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.619931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.620885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.621986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.622945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.623965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.624914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.625849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] role.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] role.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.626988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.627952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.628905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.629829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.630900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.631983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.632943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.633906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.634929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.635883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.636892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.637854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.638865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.connection = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.639956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.640995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.641948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81454) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:39:19.642584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.642806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.643050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.643282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.643521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.643758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:39:19.643929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81453) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:39:19.671834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.672062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.672163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.672288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.672374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.672545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.681025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.681345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.709184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.709414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.709586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.709819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.762217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.762772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.811143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.811326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.811682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.811923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.965884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.966951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.967032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.967167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.967384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.990862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.991977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.992107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.992189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:19.992320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.003164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.003438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.015970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.016965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81454) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.017740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81453) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 16 01:39:20.034099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.034312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 01:39:20.034460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.034659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.034743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 01:39:20.034863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 01:39:20.035000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.035141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.035225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 16 01:39:20.035407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.035488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.036188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.036272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.036451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.036533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.036725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.046938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.047022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.053890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.053989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.056771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.056977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.057059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.057986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.058973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.059061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.059243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.059324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.059509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.059588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.082344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.082482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.083828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.083912 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.084114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.084198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.088709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.088829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.088990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.089115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.089269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.089400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.095514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.095690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.095803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.095978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.101840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.102078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.102166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.102376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.102459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.102667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.102760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.102959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.103854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.104041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.119011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.119286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.119438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.119659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.123067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.123486 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.126207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.126502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.126722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.127018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.131117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.131731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.134170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.134947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.137280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.137579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.137860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.138160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.138244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.138684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.138772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.138960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.139046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.139255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.139543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.139830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.154320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.154609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.154877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.155141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.155729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.156017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.156284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.156547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.161797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.163316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.163435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.164791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.164971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.165056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.166524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.166801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.167684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.167967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.168248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.168528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.168934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.169497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.169782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.170099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.170387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.170777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.180433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.180717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.180999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.181284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.181666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.181970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.182261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.182442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.182728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.183008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.183288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.183668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.183958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.184238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.197417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.199534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.200297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.202439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.203179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.204613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.205297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.206071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.206354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.206755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.206839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.208736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.209019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.209410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.213517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.214985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.215712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.217169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.217813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.218225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.218512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.218790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.220050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.220448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.220736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.221013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.226550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.226839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.227119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.228835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.229131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.229414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.233892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81454) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.234169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.234448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.234722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.234997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.235267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.235536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.235813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81453) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 16 01:39:20.236364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.236893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81454) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.237927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.238215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.238488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.239285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.239568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.239930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.240202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.240464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81453) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 16 01:39:20.272652 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643341549c0 pid: 81454 (default app) Sep 16 01:39:20.274905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5643341549c0 pid: 81453 (default app) Sep 16 01:39:20.275440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70b12-93d9-4c41-9280-2cb760f4e7c0 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:20.275726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70b12-93d9-4c41-9280-2cb760f4e7c0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:20.275999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e70b12-93d9-4c41-9280-2cb760f4e7c0 None None] PATH_INFO: `/v3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:20.280157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 791 bytes} [Fri Sep 16 01:39:20 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:27.093704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:27.094252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:27.094357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:27.099147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1/2] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:27.104733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:27.105322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:27.105322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:27.175530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: INFO dbcounter [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] Registered counter for database keystone Sep 16 01:39:27.195356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG oslo_db.sqlalchemy.engines [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81454) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:39:27.201413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writer thread running {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:39:27.377604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG passlib.handlers.bcrypt [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81454) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 01:39:27.377956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG passlib.handlers.bcrypt [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81454) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 01:39:27.435958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:27.437550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:27.564289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 2/3] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 16 01:39:28.000096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:28.069496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: INFO dbcounter [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] Registered counter for database keystone Sep 16 01:39:28.090910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG oslo_db.sqlalchemy.engines [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81453) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:39:28.096942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writer thread running {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:39:28.219374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003805e-6e45-4e21-9127-a91c8b99ab20 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:28.224206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:28.224823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:28.225103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:28.225374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:28.233403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:28.284683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING keystone.common.rbac_enforcer.enforcer [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 01:39:28.285031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77899891-795b-4724-9c40-fc337f4b57c1 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:28.295176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1324 bytes} [Fri Sep 16 01:39:27 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 01:39:28.301691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:28.318553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1ab97-7667-4862-838a-e1fce5a799a0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:28.322922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:28.324051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:28.324332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:28.324604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] PATH_INFO: `/v3/projects/36f275dc1246410f9a8f5e0be2414a85` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:28.326217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=36f275dc1246410f9a8f5e0be2414a85)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:28.378687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING keystone.common.rbac_enforcer.enforcer [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 16 01:39:28.379032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bcc5e-5193-4dac-99d3-f758944fb9c8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:28.384042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 3/5] 10.222.0.33 () {56 vars in 1207 bytes} [Fri Sep 16 01:39:28 2022] GET /identity/v3/projects/36f275dc1246410f9a8f5e0be2414a85 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:30.482811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5b9f-1efc-45af-80e0-cd1d5530bfb9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:30.483376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5b9f-1efc-45af-80e0-cd1d5530bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:30.483376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0e5b9f-1efc-45af-80e0-cd1d5530bfb9 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:30.487436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 3/6] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:30.492922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:30.493311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:30.493483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:30.514044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:30.515588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:30.524070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 4/7] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 16 01:39:30.787841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5b9f-1efc-45af-80e0-cd1d5530bfb9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:30.799619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0e5b9f-1efc-45af-80e0-cd1d5530bfb9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:30.804265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:30.804850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:30.805131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:30.805400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:30.812850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:30.814643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8648ac05-ba69-45dd-8c30-d353a854823c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:30.823786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 4/8] 10.222.0.33 () {58 vars in 1324 bytes} [Fri Sep 16 01:39:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:39:30.828958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:30.838013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69920ee0-4e85-4b36-9aa9-4d88f0bfdeab None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:30.842297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:30.842915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:30.843200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:30.843477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:30.844778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:30.846644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022dc4e0-e2da-4a0f-bfd9-c37ea0add50e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:30.848157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 5/9] 10.222.0.33 () {56 vars in 1198 bytes} [Fri Sep 16 01:39:30 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:33.033404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295b9c-ce75-41cb-bf44-4ecef0abbc80 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.033978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295b9c-ce75-41cb-bf44-4ecef0abbc80 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.033978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64295b9c-ce75-41cb-bf44-4ecef0abbc80 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.035375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 5/10] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:39:33.040452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.040890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.041038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.059128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:33.060298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:33.100817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd121e-50fc-4512-9afa-48d9089eaec4 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.101175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd121e-50fc-4512-9afa-48d9089eaec4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.101398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd121e-50fc-4512-9afa-48d9089eaec4 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.102742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 6/11] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:39:33.107929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.108215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.108491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.141533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 6/12] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:33.150631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG passlib.handlers.bcrypt [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81453) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 16 01:39:33.151025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG passlib.handlers.bcrypt [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81453) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 16 01:39:33.200225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:33.201796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:33.304078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 7/13] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:33.409387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.434827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:33.513997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c939f-8c45-4196-8342-b791b9ea2b2d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:33.548214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:33.549012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.549449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.549794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.561653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:33.567855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:33.570445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:33.571525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:33.572472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 7/14] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:33.577108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.661720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:33.668682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b5ae8-e0e8-4d94-9d39-cfe1ef812d89 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:33.670978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:33.680209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d3e22f-5c43-487a-be11-1708a0836bbe None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:33.706865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:33.707746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.708034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.708310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.715573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:33.716209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.716522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.717211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.717914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:33.718225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:33.719985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:33.731973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 8/15] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:33.737762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.777387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:33.778946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:33.836280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103ab84-220f-4e7e-89ba-11b35c64c389 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:33.868916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:33.869536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:33.869815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:33.870113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:33.871234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:33.872664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:33.874254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 9/16] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:33.876540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 8/17] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 01:39:33.882336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.882502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:33.885207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:33.898571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:33.981474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f388f128-c41a-4ad0-a1c2-09a14563f572 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:33.984749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba322e8-12c1-4878-bc34-5c30edd31856 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:34.015119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:34.015961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:34.016241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:34.016513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:34.018247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:34.018903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:34.019186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:34.019463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:34.021222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:34.022697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:34.024246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 10/18] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:34.030550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:34.035194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:34.036644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:39:34.054604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:34.055662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:39:34.056874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:39:34.056874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:39:34.056874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:34.056874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 9/19] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:39:34.061378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:34.112159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:34.117747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:34.132263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da87130-ff1e-4928-a18e-9171da8df02d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:34.164941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dd6e6-4f3e-4d98-9d6f-e2355d8718c1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:34.165846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:34.166483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:34.166765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:34.167040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:34.167764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.domain.id=default, user.id=754ee13771964e1b8b4c099c78264d4f) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:34.168079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:34.169517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d70b57-df60-459c-8764-60c49f5c9bb5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:34.176626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 11/20] 10.222.0.33 () {56 vars in 1322 bytes} [Fri Sep 16 01:39:34 2022] GET /identity/v3/role_assignments?user.id=754ee13771964e1b8b4c099c78264d4f&scope.domain.id=default&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:34.199522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:34.200154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:34.200438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:34.200711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:34.201372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:34.201678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:34.203154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517390e7-d0bb-4445-a6cc-ec1b4531a099 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:34.222335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 10/21] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:36.593499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf6dde-e7b5-4893-bff9-46a3a56bb09d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:36.594041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf6dde-e7b5-4893-bff9-46a3a56bb09d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:36.594041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf6dde-e7b5-4893-bff9-46a3a56bb09d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:36.595331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 12/22] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:36.601686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d90-2d22-4b29-82fa-6fd665284f8d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:36.602561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d90-2d22-4b29-82fa-6fd665284f8d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:36.603133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ec9d90-2d22-4b29-82fa-6fd665284f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:36.626779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-06ec9d90-2d22-4b29-82fa-6fd665284f8d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:36.628306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-06ec9d90-2d22-4b29-82fa-6fd665284f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:36.706112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 11/23] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:36.992648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93d0b-c3b1-4658-b72f-563a044f4c75 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:36.993326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93d0b-c3b1-4658-b72f-563a044f4c75 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:36.993808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d93d0b-c3b1-4658-b72f-563a044f4c75 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:36.995436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:37.001249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8e202-ddd4-47f7-b8b6-05477b26fe9b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.001802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8e202-ddd4-47f7-b8b6-05477b26fe9b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.002342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8e202-ddd4-47f7-b8b6-05477b26fe9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.030292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-12d8e202-ddd4-47f7-b8b6-05477b26fe9b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:37.031845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-12d8e202-ddd4-47f7-b8b6-05477b26fe9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:37.088002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:37.115399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 12/25] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:37.139790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e35c9e-cddf-431b-8b16-02781d012f72 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.140079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e35c9e-cddf-431b-8b16-02781d012f72 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.140404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e35c9e-cddf-431b-8b16-02781d012f72 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.141949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 14/26] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:37.147341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.147637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.147920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.170054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:37.171304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:37.251121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 13/27] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:37.268110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e35c9e-cddf-431b-8b16-02781d012f72 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:37.411933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e35c9e-cddf-431b-8b16-02781d012f72 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:37.459134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:37.460109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.460583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.461073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.474955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:37.480468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:37.481294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:37.482074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:37.484322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 15/28] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:37.490973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:37.648170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23503c45-3d46-43b9-af46-6b9d4d3a616a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:37.656092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:37.686323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:37.695089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:37.695242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:37.696056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.696056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.696338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.697022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:37.697334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:37.698829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc58d54-6f66-4ff9-baec-f242370165d4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:37.717261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 14/29] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:37.718894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed434b-86c6-47c4-a7ab-03b66891d571 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.719185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed434b-86c6-47c4-a7ab-03b66891d571 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.719467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed434b-86c6-47c4-a7ab-03b66891d571 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.720668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 15/30] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:37.730719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed434b-86c6-47c4-a7ab-03b66891d571 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:37.816213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1e7274-e5ed-4b1d-95c0-b978841722df None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:37.845626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed434b-86c6-47c4-a7ab-03b66891d571 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:37.852523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:37.853391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.853880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.854360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.855239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:37.856827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:37.884367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:37.885057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.885351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.885627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.887143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:37.888820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27894e-d113-484e-b04f-35d45b5b2c64 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:37.890593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 16/31] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:37 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:37.891845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:37.892136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:37.892416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:37.911193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:37.912314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:37.944321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:37.986471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 17/32] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:37.987407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.005073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 16/33] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 01:39:37 2022] POST /identity/v3/roles => generated 219 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:39:38.006622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.080229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:38.100349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec2c56-8d7e-4aa8-801b-0cbe46e5c748 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.127661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8402b8f-47f1-439a-809e-f3d7da83a37f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.151083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.151756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.152040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.152318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.165463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.166898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.174094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.175268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.176329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.176963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.178602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.180616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.182549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 17/34] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:39:38.184201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:38.185023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:39:38.185845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:39:38.185845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:39:38.185845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:38.185845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 18/35] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:38.188017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.191419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.215921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:38.312564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21b60f-59df-4ed0-84d8-9529838d3028 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.341533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eddd1e-ba9d-457c-a5ab-28566da91269 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.345939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:38.361737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.362497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.362784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.363062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] PATH_INFO: `/v3/domains/default/users/754ee13771964e1b8b4c099c78264d4f/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.370900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=754ee13771964e1b8b4c099c78264d4f, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.372176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa5b7c-7897-4556-9197-0a60bfbef942 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.395188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.396150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.396888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.397442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.397558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 18/36] 10.222.0.33 () {58 vars in 1361 bytes} [Fri Sep 16 01:39:38 2022] PUT /identity/v3/domains/default/users/754ee13771964e1b8b4c099c78264d4f/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:39:38.398736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:38.399114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9377-d317-48b9-8bd6-e089bd5f2fda None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.399466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9377-d317-48b9-8bd6-e089bd5f2fda None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.399758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837f9377-d317-48b9-8bd6-e089bd5f2fda None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.400019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.401911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 19/37] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:38.403233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.407487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.408033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.408572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.421903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 19/38] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:38.427431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.460882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:38.463536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:38.560095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 20/39] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:38.560998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.603767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:38.634467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b00e90-1dab-472f-983a-0f4175038cee None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.679698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.680561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.680561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.680990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.681492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.684404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.688738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d682e-72cf-4d8f-b708-e2ddc21374a5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:38.724976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:38.740624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:38.741583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.742138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.742635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.743556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:38.745294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2897f7-a456-42cf-b44f-320c504cce55 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:38.764203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 01:39:38 2022] POST /identity/v3/roles => generated 225 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:38.765959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce6d0-f7db-401b-acf7-ba7afdc40688 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.766492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce6d0-f7db-401b-acf7-ba7afdc40688 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.767023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bce6d0-f7db-401b-acf7-ba7afdc40688 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.768658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 22/41] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:38.774754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:38.775291 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:38.775779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:38.796540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:38.798299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:38.841362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 20/42] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:39:38 2022] POST /identity/v3/projects => generated 301 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:38.863874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:38.883738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:38.997435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc388396-9824-498c-b326-bd26df72fcc3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:39.033400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:39.040679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:39.041332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:39.041620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:39.041921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:39.042885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:39.044931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:39.063069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 21/44] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 01:39:38 2022] POST /identity/v3/roles => generated 223 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:39.245978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:39.352757 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f817bf88-270e-4a09-9ed3-370025ada158 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:39.367377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:39.388472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:39.389365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:39.389649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:39.389952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:39.391068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:39.392512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d422d3-f133-4ad0-bf02-b4a0b1fb8452 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:39.394114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 24/45] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:39.399664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:39.500005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f589e3-a505-45c1-9a70-6a0e6d84e3ed None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:39.532423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:39.532978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:39.533269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:39.533549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:39.534234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:39.536482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4922b-ef28-485e-a161-b57b0486087e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:39.562297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 22/46] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:39:39 2022] POST /identity/v3/projects => generated 312 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:40.878042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d062f-59f6-4243-92c2-8e32f6c9c6ef None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:40.878585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d062f-59f6-4243-92c2-8e32f6c9c6ef None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:40.878585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d062f-59f6-4243-92c2-8e32f6c9c6ef None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:40.880443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 25/47] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:40.885802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:40.886227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:40.886399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:40.905076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:40.906630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:40.940691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:40.981012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 23/48] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:41.252392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d062f-59f6-4243-92c2-8e32f6c9c6ef None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:41.457733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d062f-59f6-4243-92c2-8e32f6c9c6ef None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:41.491859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:41.492497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:41.492786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:41.497195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:41.507414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-972221c4-516e-4af5-a9d9-d6110846b896 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:41.512576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:41.513848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:41.514637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 26/49] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:41.519863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:41.617383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7fc25-e7f9-4e53-ace5-93b10bd6d835 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:41.740344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760be57-e06a-43e5-9d4a-709d8863c7dd None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:41.740643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760be57-e06a-43e5-9d4a-709d8863c7dd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:41.740926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760be57-e06a-43e5-9d4a-709d8863c7dd None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:41.742447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 27/50] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:41.747103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:41.747398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:41.747680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:41.756170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:41.756789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:41.757074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:41.757351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:41.758099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:41.758358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:41.759819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:41.766029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:41.767236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:41.768603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 24/51] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:41.776171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:41.801896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:41.808873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:41.836943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 28/52] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:41.873001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa06b2e-f303-403e-acb5-6da467f0bb77 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:41.906065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:41.906696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:41.906981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:41.907259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:41.908398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:41.909830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:41.911453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 25/53] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:41 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:41.916873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:42.016166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c79ab8-9616-4a8e-a538-5ebd42d0db61 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:42.048743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:42.049377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:42.049662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:42.049973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:42.051612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:42.053057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:42.054822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 29/54] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:42.060393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:42.109936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:42.150323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:42.158926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5964d-c41e-47e9-b040-6f7aaaba0a73 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:42.160465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:42.193093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:42.193698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:42.194017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:42.194289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:42.195005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.domain.id=default, user.id=754ee13771964e1b8b4c099c78264d4f) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:42.195316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:42.196731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:42.205422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 26/55] 10.222.0.33 () {56 vars in 1322 bytes} [Fri Sep 16 01:39:42 2022] GET /identity/v3/role_assignments?user.id=754ee13771964e1b8b4c099c78264d4f&scope.domain.id=default&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 530 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:42.210288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15de0-0c45-429a-aba1-09d842d57c93 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:42.247206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:42.247860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:42.248146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:42.248426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:42.249579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:42.251092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd5d416-0627-4f78-af27-27bb907221a4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:42.252715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 30/56] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:42.259052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:42.370077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b27b24-8d56-477e-864e-16faee58e9ab None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:42.406940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:42.407554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:42.407845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:42.408129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:42.408802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:42.410341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442607f-efd3-4a3d-a18a-61808d951823 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:42.435878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 27/57] 10.222.0.33 () {60 vars in 1140 bytes} [Fri Sep 16 01:39:42 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:44.552769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38066864-8e93-4252-8e47-c40e9fb6b89f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:44.553256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38066864-8e93-4252-8e47-c40e9fb6b89f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:44.553256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38066864-8e93-4252-8e47-c40e9fb6b89f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:44.554600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 31/58] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:39:44.559650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:44.560082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:44.560235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:44.578807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:44.579984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:44.593144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:44.645967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 28/59] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:44.908592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38066864-8e93-4252-8e47-c40e9fb6b89f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:45.008399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38066864-8e93-4252-8e47-c40e9fb6b89f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:45.016233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:45.042055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:45.042678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:45.042963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:45.043242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:45.044351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:45.045789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29badb1-7b96-451c-b59c-d42cf73ffbca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:45.047359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 32/60] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:45.053266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:45.147183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d859ea-61f6-4207-8ba3-81952fdd53b4 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:45.179945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:45.180482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:45.180763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:45.181038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:45.181689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:45.183147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65cab4-0a42-4d43-ad63-b4549ecd3d6f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:45.208714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 29/61] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:39:45 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:39:48.422940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba76a-f9af-4d19-9fe8-75664410206e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.423936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba76a-f9af-4d19-9fe8-75664410206e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.424422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafba76a-f9af-4d19-9fe8-75664410206e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.426467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 33/62] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:48.432197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2961af-2d50-4c7f-94cf-e89ea12a6f0d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.433037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2961af-2d50-4c7f-94cf-e89ea12a6f0d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.433516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2961af-2d50-4c7f-94cf-e89ea12a6f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.443008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:48.454451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bf2961af-2d50-4c7f-94cf-e89ea12a6f0d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:48.455669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bf2961af-2d50-4c7f-94cf-e89ea12a6f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:48.551828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 30/63] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:48.634282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7b67-bf64-4eb6-83ea-fe5a489198e2 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.634597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7b67-bf64-4eb6-83ea-fe5a489198e2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.634854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea7b67-bf64-4eb6-83ea-fe5a489198e2 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.636490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 34/64] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:48.641555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de9-23d4-470c-9c4d-e385220167b8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.641856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de9-23d4-470c-9c4d-e385220167b8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.642174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c3de9-23d4-470c-9c4d-e385220167b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.661830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7e4c3de9-23d4-470c-9c4d-e385220167b8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:48.663068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7e4c3de9-23d4-470c-9c4d-e385220167b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:48.756087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 31/65] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:48.881126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea7b67-bf64-4eb6-83ea-fe5a489198e2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:48.889489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589947-1462-40c3-ac27-cb18215c2c3c None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.890057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589947-1462-40c3-ac27-cb18215c2c3c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.890509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b589947-1462-40c3-ac27-cb18215c2c3c None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.892081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 32/66] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:39:48.904910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b22b2f-f653-4206-8201-e7cec5356fe5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:48.905219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b22b2f-f653-4206-8201-e7cec5356fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:48.905478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b22b2f-f653-4206-8201-e7cec5356fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:48.941323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-44b22b2f-f653-4206-8201-e7cec5356fe5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:48.942563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-44b22b2f-f653-4206-8201-e7cec5356fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:49.018452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea7b67-bf64-4eb6-83ea-fe5a489198e2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.045739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.056543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 33/67] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:49.057278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.065890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.065890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.065890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.066658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a1f-6fc2-4dea-a280-6d43a653c030 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.066658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a1f-6fc2-4dea-a280-6d43a653c030 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.066658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a1f-6fc2-4dea-a280-6d43a653c030 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.066658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 34/68] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:49.071253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.071537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.071813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.085616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:49.090649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:49.091505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:49.092269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 35/69] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:49.099380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.109003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:49.110295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:49.154627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.195902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 35/70] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:49.196578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.229788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6047655-fe04-402d-a0b4-c6a071b89f84 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.286806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.287436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.287722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.288004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.288684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:49.289094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:49.294611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29ec11-a4a7-4164-b054-0399c6a53f1e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:49.304794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e53ebb-66a5-46e5-8587-3e543a0f8312 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.309048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 36/71] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:49.310553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedf99-7e56-4774-bff2-4ed8467c7fa9 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.311018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedf99-7e56-4774-bff2-4ed8467c7fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.311446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bedf99-7e56-4774-bff2-4ed8467c7fa9 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.312801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 37/72] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:49.318078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bedf99-7e56-4774-bff2-4ed8467c7fa9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.344150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.348519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.349533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.349826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.362585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-9ca5301b-3530-4750-baab-314ecefddad8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:49.370482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:49.371352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:49.372226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:49.372855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.373098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.373520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.394578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:49.396004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:49.440008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.450021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bedf99-7e56-4774-bff2-4ed8467c7fa9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.465484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 37/74] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:49.466194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.495690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.496721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.497207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.497683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.514191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:49.516191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:49.518279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 38/75] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:49.519968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.570345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f8bbae-aef1-48c7-b337-3634510f5038 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.584242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.604844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.605456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.605745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.606056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.606732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:49.607040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:49.608417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:49.621548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 38/76] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:49.621548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.631142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d712c5d-a149-43aa-a080-2e08daa319ff None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.670803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.671452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.671732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.672015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.684837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:49.689704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:49.690673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:49.691509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 39/77] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:49.692154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.714599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.736909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55f1a2b-be86-4c78-a1dc-23907ec8c2e8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.771059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.771891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.772175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.772461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.782341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:49.788346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:49.789410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 39/78] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:49.790428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:49.804776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f649c-9846-4245-af84-17051aace71a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.827025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.848973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.849596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.849903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.850267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.892385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc48fe44-1538-4be6-8938-1c4ab3ca9015 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:49.916618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:49.918138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:49.926475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:49.927110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:49.927403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:49.927742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:49.928963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:49.930509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:49.932087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 40/79] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:49.932275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:49.932850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.021041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 40/80] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:39:50.021922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.035543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a97274-6a18-4a53-9475-28d9287ea656 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.037851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.071149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.071757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.072042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.072318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.072974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:50.073346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.074777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.082426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 41/81] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:39:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.083199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.121156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7099e4e-1937-45c3-9723-17fe92785c54 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.135420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.156963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.157590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.157897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.158184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.159323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.160802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.162398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 41/82] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.163178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.186633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4d5655-9e5e-41dd-8fba-44ae9a8f33a5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.219976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.220584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.220869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.221146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.221804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:50.222177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.223544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.231371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 42/83] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.234746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.261334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4eca3-3b34-49dd-8a5d-aafbfb505114 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.263929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.299426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.300045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.300331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.301126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.336786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f499-f42a-4079-bdf2-4b1a38683bcd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.349761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.368609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.369951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.370146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.370586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.370877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.371162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.372298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.373725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.375555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 43/84] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.376149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.468536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 42/85] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:39:50.469355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.473530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.476524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f6f69-c059-47d4-9071-716a3e7fa0e5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.511095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.511728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.512011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.512289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.513412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.515140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.516697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 44/86] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.517447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.554714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.574127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214bcb2-6eed-4e0c-a2a0-400d97bcfd45 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.607430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.608036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.608323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.608601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.609247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.610722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.617233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18be623c-4ec6-454f-b867-21fb65c709b9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.637387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 43/87] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:39:50 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:50.639012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.655107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.655767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.656052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.656330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.658122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.659629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.662258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 45/88] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.662866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.706316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.762195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392363a-d70c-43bb-9fa5-63cc3ff66dab None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.785559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922edd0d-9309-4df0-bb90-2fe7f0937b4a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.804914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.805456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.805740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.806064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.806991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:50.807157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.808605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.814857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 44/89] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1620c8d7a29041378a32461a8cde3643 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.816547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.820405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.833154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:50.833830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:50.834149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:50.834427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:50.835909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:50.838054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:50.844817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 46/90] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:50.844817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:50.961392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4273b0-0fd7-454d-9ec8-f5718d183124 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:50.982764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:50.985921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870983b3-734e-41b2-a5de-1c3062e22b1c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.008703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.009775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.010560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.010993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.032760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.033461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.033729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.033953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.108066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.110176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.112650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:51.116104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.117660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.236572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 45/91] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:39:51.236572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:51.248377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:51.254610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 47/92] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:39:51.260652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:51.381972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d212a-8e16-4d9a-baf1-b1a39cf6f02e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.415738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.416386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.416670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.417007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.418251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.419653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.421820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 48/93] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:51 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:51.422613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:51.476032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb54d4-bcd7-48af-b9d2-14f495edc847 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.477654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:51.497845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:51.550699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.551316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.551597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.551872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.552606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=754ee13771964e1b8b4c099c78264d4f) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:51.552912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.554390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.560969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ba6126-3eaa-4ca8-8a2f-5036939d566c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.573659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 46/94] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:51 2022] GET /identity/v3/role_assignments?user.id=754ee13771964e1b8b4c099c78264d4f&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:51.578820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:51.657343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.657948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.658238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.658517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] PATH_INFO: `/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.659782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ed007e69cd46148ea48c3ba5daf8cd)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.661332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.662994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 49/95] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:51 2022] GET /identity/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:51.669271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:51.827342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6afeb0-b6ea-40fc-ad19-4fa55e9fd740 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.839457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f635a-602a-40c6-b557-e502da871760 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:51.899194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.899816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.900096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.900372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.901107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=a4ed007e69cd46148ea48c3ba5daf8cd, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:51.901415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.902872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152b145-3d83-4283-bbbe-55b83ccb716d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.910114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:51.910655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:51.910935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:51.911208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:51.911952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:51.912263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:51.913747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a552f0-5566-4aa3-9f64-92094f6e17a1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:51.914268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:51.918949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 50/96] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:51 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=a4ed007e69cd46148ea48c3ba5daf8cd&role.id=1620c8d7a29041378a32461a8cde3643 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:51.923491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 47/97] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:51 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1ef4118652b24050b863bd53ae59decc => generated 259 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:53.188350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526919-d809-4db7-8d5a-b3a6d37db5c4 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:53.189605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526919-d809-4db7-8d5a-b3a6d37db5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:53.189949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21526919-d809-4db7-8d5a-b3a6d37db5c4 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:53.191609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 51/98] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:53.197101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b47ca-51d6-4b0f-ad02-c92f08ca1977 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:53.197955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b47ca-51d6-4b0f-ad02-c92f08ca1977 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:53.198449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b47ca-51d6-4b0f-ad02-c92f08ca1977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:53.239355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-bb0b47ca-51d6-4b0f-ad02-c92f08ca1977 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:53.241010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bb0b47ca-51d6-4b0f-ad02-c92f08ca1977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:53.322286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:53.376221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 48/99] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:53.891490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319ed0-fa55-4462-bdf0-5eaaeb06f956 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:53.891490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319ed0-fa55-4462-bdf0-5eaaeb06f956 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:53.891490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319ed0-fa55-4462-bdf0-5eaaeb06f956 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:53.891490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 52/100] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:53.903134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9553f6-9eb8-41a8-958c-a5aa5575a94a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:53.903459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9553f6-9eb8-41a8-958c-a5aa5575a94a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:53.903702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9553f6-9eb8-41a8-958c-a5aa5575a94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:53.935061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0f9553f6-9eb8-41a8-958c-a5aa5575a94a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:53.936287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0f9553f6-9eb8-41a8-958c-a5aa5575a94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:54.011868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0319ed0-fa55-4462-bdf0-5eaaeb06f956 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.016237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 49/101] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:54.094857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a775a-dd0a-4eb5-abfd-d4768f11c25a None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.095185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a775a-dd0a-4eb5-abfd-d4768f11c25a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.095429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a775a-dd0a-4eb5-abfd-d4768f11c25a None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.096774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 50/102] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:39:54.102787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.103079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.103360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.151128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:54.152962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:54.156291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0319ed0-fa55-4462-bdf0-5eaaeb06f956 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:54.217648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:54.219113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.219592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.220059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.248211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:54.273270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:54.274131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:54.274898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:54.280007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 53/103] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:39:54.287087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.304801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 51/104] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:54.360669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.394785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:54.407565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:54.421564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871b539-6540-42b7-a5fc-8cbc180823ff None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:54.461835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:54.462804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.463270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.463724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.464573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:54.465057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:54.467761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:54.478868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 54/105] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:54.486853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.583721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f50079-dd3f-46b6-82da-bad714c09f5d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:54.633242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:54.634368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.635360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.636453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.638417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:54.640902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:54.642877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 52/106] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:54.650351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.652425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bffec7-f51d-4ae1-80c8-209a01e73db8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:54.688687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:54.707027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:54.707684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.707972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.708251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.709423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:54.718477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:54.720507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 55/107] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:54.721303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.779466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52306-550a-43d8-a47d-afcec16de8c3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:54.788289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:54.821731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:54.822745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:54.823206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:54.823656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:54.824492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:54.826148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:54.859926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 53/108] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:39:54 2022] POST /identity/v3/projects => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:39:54.861224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:54.961845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e1b33c-b475-46b3-bb52-7c5073c2d435 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.040456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.041428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.041941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.042526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.065106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:55.072398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:55.073410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:39:55.074203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:55.082143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 56/109] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:55.084055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbf6a1-b7b5-40fe-955f-dc86940b989f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.089787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:55.170334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.171172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.171572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.171946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.177904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:55.178345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:55.180342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 54/110] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:54 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:55.186139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:55.197252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:55.205949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:55.286379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b5f97-a394-46f4-85e3-0bc87a287253 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.327399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.328053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.328343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.328627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.329470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:55.329788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:55.331898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295047-a7b9-4657-9ed2-99f3a4bbdb93 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:55.336961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace02200-0bf7-4c54-aa71-02d797832df9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.341648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 57/111] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:55.343053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e822-7126-4bc2-a269-d98f90097e37 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.343348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e822-7126-4bc2-a269-d98f90097e37 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.343633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5e822-7126-4bc2-a269-d98f90097e37 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.344871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 58/112] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:55.350789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5e822-7126-4bc2-a269-d98f90097e37 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:55.383028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.384101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.384660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.385136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.389231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, user_id=e62d6fa6d30e4862901cd65d25e63ede, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:55.391440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65effaff-7595-4793-8e23-3f7c74719016 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:55.415167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 55/113] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:39:55 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:39:55.417800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.418355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.418852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.447825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:55.449566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:55.488616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5e822-7126-4bc2-a269-d98f90097e37 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.511056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:55.535349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.535913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.536206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.536488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] PATH_INFO: `/v3/users/b922079c595a49abb81f8db592b7de85` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.552459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:55.555842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] RBAC: Authorizing `identity:get_user(user_id=b922079c595a49abb81f8db592b7de85)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:55.557294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0d99d-292e-4174-b254-2aafba667e1b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:55.559391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 59/114] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:55 2022] GET /identity/v3/users/b922079c595a49abb81f8db592b7de85 => generated 289 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:55.560412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d903-927a-44f2-91fb-5ad2288fc64d None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.560704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d903-927a-44f2-91fb-5ad2288fc64d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.560987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148d903-927a-44f2-91fb-5ad2288fc64d None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.561607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 56/115] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:55.565126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:55.567109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 60/116] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:55.573973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a12f3-b497-4aca-9806-82508c3d894c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.574266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a12f3-b497-4aca-9806-82508c3d894c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.574547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a12f3-b497-4aca-9806-82508c3d894c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.627080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f81a12f3-b497-4aca-9806-82508c3d894c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:55.633338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f81a12f3-b497-4aca-9806-82508c3d894c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:55.712643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ca8e85-310d-4213-81d9-24fc144ac732 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:55.753041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 61/117] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:55.754753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fd1a-af95-4d2c-a7a5-6f2f9bb9a539 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.755051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fd1a-af95-4d2c-a7a5-6f2f9bb9a539 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.755335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336fd1a-af95-4d2c-a7a5-6f2f9bb9a539 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.756705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 62/118] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:55.761833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.762162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.762448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.781133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:55.782376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:55.822205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:55.822761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:55.823047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:55.823328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:55.927987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:55.936887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 63/119] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:39:55.937765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:55.940711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:55.942311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:55.973656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.107643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07279253-dc9a-4b98-a39f-17abb0ba2068 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.155929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.156826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.157489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.158619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.180245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:56.192728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 57/120] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 01:39:56.193919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:56.194650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:56.195690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:39:56.196638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:39:56.200310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 64/121] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:39:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:56.201318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.354613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.358659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.363369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe7108-cc67-4519-a146-6af8adc8ceac None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.369508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a52513-7254-4db5-98c1-e91eae13899d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.402733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.403590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.404017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.404391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.411989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.412825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.413360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.413774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.415195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:56.416806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:56.417267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:56.418778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 65/122] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:56.419857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:56.422829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:56.423906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:56.424765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 58/123] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:56.426028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.555720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a212bb-168c-4b99-b7f6-90a3f01824e5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.555990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3231d53-f835-4db1-889a-219b2517ac72 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.604449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.605458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.605569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.606025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.606194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.606480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.606758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.606860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.607463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:56.607773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:56.609330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:56.618543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 66/124] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:56.619339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.620934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:56.626721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:56.627796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:56.628808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:56.635711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 59/125] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:56.635711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.655065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.664671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.747163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c78ffa-2c15-4ef2-8d7f-dd1693e457df None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.767747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8f78a-0097-4825-ab5e-8b32aea4199a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:56.794132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.795299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.796114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.796866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.798037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=b922079c595a49abb81f8db592b7de85) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:56.798388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:56.799859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:56.806697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 67/126] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/role_assignments?user.id=b922079c595a49abb81f8db592b7de85&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:56.807746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.807919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:56.808595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:56.808883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:56.809256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:56.810234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:56.810234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:56.811717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:56.833169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 60/127] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:56.834193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:56.981672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:56.993136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.008213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d942ed65-15be-429e-8b08-f348fd27dc7f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.017534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553fd3-7ccf-4c5c-b4a2-d1169ce93024 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.051902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.052523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.052806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.053086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.053751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:57.054216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.055664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.064862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 61/128] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.065437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.118648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.119470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.119767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.120051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.121231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.122943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.124699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 68/129] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:56 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.125275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.191861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36451c77-2ee1-40ef-bcb8-2d5da0429329 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.241986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.242795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.243082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.243360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.245509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.247000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.248811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 62/130] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:57 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.249358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.278267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.310101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac65189-103b-491b-b4ff-38f4441db3bd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.379517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.380282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.380482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.380765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.384223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.386144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.389035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 69/131] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:57 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.393736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.419923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a0fb4-b938-4464-b483-cdf2ccfa3158 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.437358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.474896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.475543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.475825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.476101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.478460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.479912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.481764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 63/132] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:57 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.482347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.588173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2199219e-2862-40eb-b6ed-f77a85d4eaf2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.634222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.649644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.650321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.650603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.650878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.655482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.656931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.658669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 70/133] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:57 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.659348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.679760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591339cc-0acc-472e-a264-8d8ca594b44f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.715793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.716493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.716778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.717052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] PATH_INFO: `/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.718662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ed007e69cd46148ea48c3ba5daf8cd)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.720775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.723628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 64/134] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:57 2022] GET /identity/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:57.724386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.846643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a362af2-b2a4-48fc-96ff-e46f5fd19e89 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.875723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.889694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbc9db-ca9b-47f1-b335-ac4675edf648 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:57.895013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.895685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.895967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.896241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.898533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, user_id=e62d6fa6d30e4862901cd65d25e63ede, role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.900486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.919102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 65/135] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:39:57 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1ef4118652b24050b863bd53ae59decc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:39:57.919692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:57.933513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:57.936745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:57.937793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.938470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.939553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/754ee13771964e1b8b4c099c78264d4f/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.942524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, user_id=754ee13771964e1b8b4c099c78264d4f, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:57.944319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52c3ea-440c-4b45-a337-1582a46e0a60 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:57.963342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 71/136] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:39:57 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/754ee13771964e1b8b4c099c78264d4f/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:39:57.965195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f542889-d780-4677-a8d2-aa11f988e228 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.965813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f542889-d780-4677-a8d2-aa11f988e228 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.966355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f542889-d780-4677-a8d2-aa11f988e228 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:57.968098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 72/137] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:57.974968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd8ef-89b6-4257-8c80-73f3aa2425dc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:57.975601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd8ef-89b6-4257-8c80-73f3aa2425dc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:57.976155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3bd8ef-89b6-4257-8c80-73f3aa2425dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.004283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0b3bd8ef-89b6-4257-8c80-73f3aa2425dc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:58.006562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0b3bd8ef-89b6-4257-8c80-73f3aa2425dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:58.091616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 73/138] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:58.105627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c9da2-4864-42cb-ac8b-2c87762eb888 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:58.161456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:58.162185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.162471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.162751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] PATH_INFO: `/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.164753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4ed007e69cd46148ea48c3ba5daf8cd, user_id=e62d6fa6d30e4862901cd65d25e63ede, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:58.166331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90731c2a-5790-484a-8042-444220c48e37 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:58.189902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 66/139] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:39:57 2022] PUT /identity/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd/users/e62d6fa6d30e4862901cd65d25e63ede/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:39:58.199815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e876f-3d20-46b6-bfa7-039cf0f86dc9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.200461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e876f-3d20-46b6-bfa7-039cf0f86dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.200995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e876f-3d20-46b6-bfa7-039cf0f86dc9 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.202723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 74/140] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:58.209055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.209438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.209728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.232205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:58.233533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:58.318286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:58.330071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 67/141] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:39:58.449384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e876f-3d20-46b6-bfa7-039cf0f86dc9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:58.546956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:58.583569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e876f-3d20-46b6-bfa7-039cf0f86dc9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:58.616986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:58.630240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:58.630893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.631175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.631449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.632586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:58.634067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:58.635638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 75/142] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:39:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:58.641920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:58.845969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d78e66-4464-4b3d-b8dc-375211264730 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:58.860303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3296db0-4cf4-46e4-964e-c41bb4a98c20 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:58.910628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:58.911436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.911728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.912008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.923244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:39:58.924079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:58.924703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:58.924983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:58.925368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:58.926161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:58.927600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:39:58.928204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:39:58.929089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:39:58.929898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 68/143] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:39:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:39:58.935710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:58.977589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 76/144] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:39:58 2022] POST /identity/v3/users => generated 283 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:39:59.033409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:59.092774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef809f67-7c8f-4681-848c-aaf5ecb05c16 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:59.139878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:59.140857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.141337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.141815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.142752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:39:59.143275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:59.144973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:59.155136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 69/145] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:39:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:39:59.161402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:59.183239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:59.277891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0828b38-f773-4562-a4d0-801781fc0dda None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:59.310522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:59.311169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.311451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.311725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.312881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:59.314455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:59.316231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 77/146] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:39:59 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:59.321964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:59.444358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75554473-f6c2-4d08-b94d-ba99171613bd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:59.464913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:59.486312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:59.486994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.487290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.488095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.559718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:59.561194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e361b-2491-4f5e-bc2d-0654b1a0ab0a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:59.696743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 70/147] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:39:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:39:59.702569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:39:59.761282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746830-4c49-4cb0-b954-101fdb78cb9b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.761614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746830-4c49-4cb0-b954-101fdb78cb9b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.761856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56746830-4c49-4cb0-b954-101fdb78cb9b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.763540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 71/148] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:39:59.768657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.769027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.769320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.810975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:39:59.812220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:39:59.814884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:59.830117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d310-bb97-4e7e-9535-7575d8e412e8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:39:59.844587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:39:59.872117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:39:59.872826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:39:59.873110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:39:59.873432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:39:59.874610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:39:59.876693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:39:59.885297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 78/149] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:39:59 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:39:59.886408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:00.000719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0cf22-d85a-44f1-afcc-ea75d5313f24 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:00.040895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:00.041558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:00.041844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:00.042145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:00.042885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:00.043199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:00.044672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:00.052004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 72/151] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:39:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:00.053140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 79/151] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:39:59 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1620c8d7a29041378a32461a8cde3643 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:00.429036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:00.545621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89475097-3955-42ea-a6a9-b002859258f1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:00.588468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:00.589132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:00.589419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:00.589704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:00.602623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:00.607571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:00.608544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:00.609352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 73/152] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:00.616444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:00.619440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:00.741105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e8cc60-4ce3-4b27-b797-adacb87141d3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:00.783628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:00.784253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:00.784611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:00.784892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:00.785570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:00.785897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:00.787301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:00.803529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 80/153] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:00.809311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:00.821215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:00.935955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060379b-f4ff-44c0-b508-3db75383407d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:00.985283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:00.985968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:00.986256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:00.986533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] PATH_INFO: `/v3/users/b922079c595a49abb81f8db592b7de85` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:00.988256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] RBAC: Authorizing `identity:get_user(user_id=b922079c595a49abb81f8db592b7de85)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:00.989732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:00.991362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 74/154] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:00 2022] GET /identity/v3/users/b922079c595a49abb81f8db592b7de85 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:00.997124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:01.070942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:01.121840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b679de73-b3b9-44aa-b07f-9bb1974afe97 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:01.171128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:01.171780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.172065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.172345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.173494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:01.175012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c40f2-f68b-4531-84df-c39cb1397599 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:01.176691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 81/155] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:00 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:01.182533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:01.216044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99501-e684-48e0-a10e-a59dff3e0cee None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.216374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99501-e684-48e0-a10e-a59dff3e0cee None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.216658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e99501-e684-48e0-a10e-a59dff3e0cee None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.218044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 82/156] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:01.227669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211be27-738f-4dfb-ab7c-c971da3aab3f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.227950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211be27-738f-4dfb-ab7c-c971da3aab3f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.228235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a211be27-738f-4dfb-ab7c-c971da3aab3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.266782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a211be27-738f-4dfb-ab7c-c971da3aab3f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:01.270374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a211be27-738f-4dfb-ab7c-c971da3aab3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:01.341754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:01.407048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7bcdc-068c-4488-8ac2-73b1ceb18821 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:01.462194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 83/157] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:01.477114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:01.477798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.478132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.478417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/b922079c595a49abb81f8db592b7de85/roles/7a01b6b970cf4271a9941bbdd64a6909` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.480384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, user_id=b922079c595a49abb81f8db592b7de85, role_id=7a01b6b970cf4271a9941bbdd64a6909)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:01.481905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916bafa-55fa-480f-9e12-2556c7b938f7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:01.498092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 75/158] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:40:01 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/users/b922079c595a49abb81f8db592b7de85/roles/7a01b6b970cf4271a9941bbdd64a6909 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:01.920812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1fd6a-d04e-41ec-b726-2e5b2091d8fc None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.921368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1fd6a-d04e-41ec-b726-2e5b2091d8fc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.921368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1fd6a-d04e-41ec-b726-2e5b2091d8fc None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.923025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 84/159] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:01.930055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:01.930554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:01.930637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:01.955632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:01.956959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:01.958466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1fd6a-d04e-41ec-b726-2e5b2091d8fc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.033208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 76/160] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:02.070240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:02.123540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1fd6a-d04e-41ec-b726-2e5b2091d8fc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:02.167760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:02.168402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.169004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.169281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.183030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:02.188027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:02.189020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:02.189815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 85/161] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:02.198493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.280467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:02.317494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c75caf3-b81c-4349-9080-5baaa02dbb9f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:02.355078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:02.355698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.355982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.356261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.356929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:02.357235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:02.358647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b20231-9629-4e13-88c4-34150ef7dcf6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:02.367966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 77/162] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:02.373447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.422873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd32be-e0aa-4d45-a9c3-9edbe9591c9b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.423175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd32be-e0aa-4d45-a9c3-9edbe9591c9b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.423447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbd32be-e0aa-4d45-a9c3-9edbe9591c9b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.424993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 78/163] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:02.434924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.435178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.435420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.476389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:02.477633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:02.539310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4ae7de-f9bd-4afa-aed9-f17f1f4278a6 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:02.569688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:02.599133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:02.599788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.600073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.600345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] PATH_INFO: `/v3/users/754ee13771964e1b8b4c099c78264d4f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.606636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] RBAC: Authorizing `identity:get_user(user_id=754ee13771964e1b8b4c099c78264d4f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:02.608097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:02.609726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 86/164] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:02 2022] GET /identity/v3/users/754ee13771964e1b8b4c099c78264d4f => generated 247 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:02.610561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.617118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 79/165] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:02.618129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.723497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:02.798420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3db9d-3f6c-49ae-a429-9e1febd2fb83 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:02.841496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519c0b6-0d1c-4ad9-8dd6-191e88c60283 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:02.858676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:02.859644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.860135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.860663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.922597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:02.923313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:02.923529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:02.923897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:02.953891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:02.955713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:02.957176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:02.958232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 87/166] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:02.962962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:02.982265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:02.984454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:03.073988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:03.094213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:03.168693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613adce-0f77-4027-8f65-eedd273f53d4 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:03.188881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 80/167] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:03.189807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.203836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:03.204460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.204745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.205020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.205695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:03.206032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:03.207947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:03.216721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 88/168] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:03.217676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.392320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ae849-d8d2-497d-addb-a28016969814 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:03.412693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:03.462602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aacdbde-4c96-45ba-81e1-7346f17cb022 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:03.477922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:03.477922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.477922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.477922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.481327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:03.482903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:03.484487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 89/169] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:03.487984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.513057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:03.514424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.514909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.515403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.527327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:03.532665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:03.533576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:03.535046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:03.537538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 81/170] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:03.538930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.566678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:03.686388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45127bb0-e6f9-47a3-89cb-c4972568a84a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:03.730105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:03.730719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.730999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.731271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.732000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=754ee13771964e1b8b4c099c78264d4f) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:03.732309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:03.733758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:03.745770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 82/171] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/role_assignments?user.id=754ee13771964e1b8b4c099c78264d4f&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:03.746620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.777799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204812cf-b617-4582-8377-c2b90cd10df7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:03.845204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:03.846270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.846789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.847848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.849281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:03.851868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e069ffb-19c2-4fc6-8132-595bed1ade8c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:03.860500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 90/172] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:03.862250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f27f-77d2-4e57-9872-1560613c4693 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:03.862838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f27f-77d2-4e57-9872-1560613c4693 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:03.863434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f27f-77d2-4e57-9872-1560613c4693 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:03.864930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 91/173] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:03.868399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f27f-77d2-4e57-9872-1560613c4693 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:03.955424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:03.979422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.009902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b016f-cb86-4ad3-b158-f37f204100cc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.075705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00f27f-77d2-4e57-9872-1560613c4693 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.115285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.115926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.116216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.116494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.117182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:04.117489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.119015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eaec93-212d-4932-9cd3-d441ea545ab9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.133815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 83/174] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:04.135078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.135366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.135644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.151732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.152370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.152656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.152934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.171551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:04.173096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:04.256393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.258063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d628d2-3d88-4fb4-9123-cb8cb535d51d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.260835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 84/175] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:04.261540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:04.321923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.361935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.382765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 92/176] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:04.384165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db5a-34c1-4501-bae1-aae1c54111dd None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.384472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db5a-34c1-4501-bae1-aae1c54111dd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.384733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e9db5a-34c1-4501-bae1-aae1c54111dd None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.386043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 93/177] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:04.387043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f54f5-d2cf-434c-9852-79c40ba21324 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.387389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f54f5-d2cf-434c-9852-79c40ba21324 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.387831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f54f5-d2cf-434c-9852-79c40ba21324 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.390129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 94/178] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:04.391766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d8f10-014b-4bfe-a746-3bd270a0f559 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.395699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ecb-9e70-41cd-8f91-3c7a21c85a94 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.395985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ecb-9e70-41cd-8f91-3c7a21c85a94 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.396264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac1ecb-9e70-41cd-8f91-3c7a21c85a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.415332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3aac1ecb-9e70-41cd-8f91-3c7a21c85a94 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:04.416535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3aac1ecb-9e70-41cd-8f91-3c7a21c85a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:04.432299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.433191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.433475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.434226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] PATH_INFO: `/v3/users/e62d6fa6d30e4862901cd65d25e63ede` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.435444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] RBAC: Authorizing `identity:get_user(user_id=e62d6fa6d30e4862901cd65d25e63ede)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.436905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.438576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 85/179] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/users/e62d6fa6d30e4862901cd65d25e63ede => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:04.439346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:04.503601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 95/180] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:04.513210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.513210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.513210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.540695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:04.543443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:04.615176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ecfb8-76c7-4ae5-af11-395b4fea8b49 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.656926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.657120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 96/181] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:04.657700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:04.664949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.665382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.665893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.668361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.671122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.672670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.674554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 86/182] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:04.675722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:04.688252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.772714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574449f-55fd-4dd9-aff0-5f9f35bc5782 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.783056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da294b88-c4a9-4e6c-9cf9-80ec24a14e46 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.811100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.811719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.812005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.812283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.820260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.821131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.821603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.822123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.835631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9e472ff7-eedc-433a-9ba4-43be2817135b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:04.840840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:04.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 87/183] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:04.846907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4abf0-c525-427d-b5e2-83eb32eb9bd1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.847628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4abf0-c525-427d-b5e2-83eb32eb9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.847628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4abf0-c525-427d-b5e2-83eb32eb9bd1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.847628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 88/184] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:04.847628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4abf0-c525-427d-b5e2-83eb32eb9bd1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:04.892704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.894208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.903835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.921826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:04.955222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4abf0-c525-427d-b5e2-83eb32eb9bd1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:04.989262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:04.989889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:04.990174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:04.990454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:04.991174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:04.991488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:04.992941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:04.994775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 97/185] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:04.994775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.014008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 89/186] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1ef4118652b24050b863bd53ae59decc => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.014008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.104666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51942229-f4a3-45fe-aa18-2e5aac800c5a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.113088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8a3b3-0954-4b16-8bef-754ecb781394 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.115719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.145435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.146032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.146317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.146593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.147774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.149247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38348b76-4cef-4b6d-9025-35f1a23bc7ef None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.151124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 98/187] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.152237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.152522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.152798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.156121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.156763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.157063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.157322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.158041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:05.158354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.159812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.161506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.170685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 90/188] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.171566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.173374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:05.174603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:05.254541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 99/189] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:05.256049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.299517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a8008-6ccd-449e-8350-02acead4f613 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.336844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.337811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.338128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.338404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.348992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:05.353958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:05.354878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 91/190] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:05.355775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.372788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89f08c-d3a9-425b-b399-9d0d86b52a64 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.381375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.411708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.416746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.417388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.417669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.417972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] PATH_INFO: `/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.419176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] RBAC: Authorizing `identity:get_project(project_id=a4ed007e69cd46148ea48c3ba5daf8cd)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.420538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.422517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 100/191] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/projects/a4ed007e69cd46148ea48c3ba5daf8cd => generated 312 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.423743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.459012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c2e1b-48c0-4639-b510-665d09bb931c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.497035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.498022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.499238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.499762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.500835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.502339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.525920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 92/192] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:05 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:05.530883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.539769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ec86c-825f-4c81-88c5-c40eac6b2bd2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.587174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.587848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.588237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.588404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.605972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.607710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.609644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 101/193] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.615792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.650913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.651889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d6855-5c65-4023-957b-fb24c2c866cf None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.667992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.693690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.694336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.694616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.694893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.695560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:05.695863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.697682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.706828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 93/194] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.711415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.736874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea0340-c2d1-42fa-a08a-61ed55e39c13 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.776533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.777150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.777436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.777716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.778489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=a4ed007e69cd46148ea48c3ba5daf8cd, user.id=e62d6fa6d30e4862901cd65d25e63ede) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:05.778807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:05.780250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:05.787575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 102/195] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/role_assignments?user.id=e62d6fa6d30e4862901cd65d25e63ede&scope.project.id=a4ed007e69cd46148ea48c3ba5daf8cd&role.id=1620c8d7a29041378a32461a8cde3643 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:05.788127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.853900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c55e9a-2dc9-425b-a73b-18542a591892 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.905201 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.905957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.906416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.906576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:05.918118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:05.923635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:05.924642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:05.926102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 94/196] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:05.926753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:05.938237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.946498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196087d-effc-4eda-bdae-1b54437655b1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:05.980382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:05.992189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:05.992838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:05.993185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:05.993459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.063178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d3b381-a109-4492-8c0f-ba5b9ef227c6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.072560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.074427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.101321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.102048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.102331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.102663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.103833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.105306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.108756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 95/197] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.109549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.188588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.196609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 103/198] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:06.197526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.230546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dc0d7-0db9-4851-9840-06689722e12d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.250300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.279753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.280360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.280641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.280916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.281588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:06.281921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.283358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.295145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 96/199] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.296374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.319146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb85bea-f341-45d5-a052-518f1e8bbb45 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.359090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.359727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.360007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.360280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.429431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd352acd-a689-48d1-ae63-d5a4c9a24265 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.434276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.441933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.444317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.478179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.479397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.480200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.480891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.482228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.485045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.491520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 97/200] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.491520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.526784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.575509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 104/201] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:06.581628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.601297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e03c16-1cdf-485c-aecc-db16765cbc4b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.636225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.637013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.637393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.637763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] PATH_INFO: `/v3/users/b922079c595a49abb81f8db592b7de85` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.639313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] RBAC: Authorizing `identity:get_user(user_id=b922079c595a49abb81f8db592b7de85)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.640852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.642922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 98/202] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/users/b922079c595a49abb81f8db592b7de85 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.644024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.702483 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.711098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b865a3c1-1615-4369-88e5-44edd9d612fc None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.750558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.751647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.752029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.752527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.753589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=bf996c8ead3446839dfc7b7b73b6a354) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:06.754042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.755622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.759159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:06.762931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 105/203] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/role_assignments?user.id=bf996c8ead3446839dfc7b7b73b6a354&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.767983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:06.768165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1b77a4-c927-4542-b21e-2bdf8b9aaeb6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:06.842765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:06.843483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:06.843763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:06.844038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:06.848126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:06.849615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:06.854475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 99/204] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:06.860482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:07.001567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbf13c-45ce-4b9a-9df0-66ed3be19d16 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:07.004164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c93b73-52dc-4320-aead-b55efdc00da4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:07.050040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:07.050665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:07.050944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:07.051216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:07.051948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=bf996c8ead3446839dfc7b7b73b6a354) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:07.052257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:07.053715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:07.055165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:07.055984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:07.056457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:07.056904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:07.059681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 100/205] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/role_assignments?user.id=bf996c8ead3446839dfc7b7b73b6a354&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1ef4118652b24050b863bd53ae59decc => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:07.116411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:07.169708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:07.171566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:07.304815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 106/206] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:07.310404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:07.344308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:07.448112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778bb01-3ecb-4ab6-8e11-a3dc4d4d9867 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:07.496471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:07.497112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:07.497392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:07.497665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:07.498840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:07.500294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f4f4a-924c-4f74-8d1c-ad0845a213a9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:07.502246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 101/207] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:07 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:07.508173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:07.584085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:07.638331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b24a85-a7ad-4300-8316-5d86e8291c25 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:07.680422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:07.681042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:07.681324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:07.681598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:07.682359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0, user.id=b922079c595a49abb81f8db592b7de85) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:07.682670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:07.684114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8e2ad6-8b95-4d8f-b064-bbe35c261638 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:07.694387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 107/208] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:07 2022] GET /identity/v3/role_assignments?user.id=b922079c595a49abb81f8db592b7de85&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:08.191768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d790-b96b-4868-a4f6-42dbc04b5b13 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.192164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d790-b96b-4868-a4f6-42dbc04b5b13 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.192369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b2d790-b96b-4868-a4f6-42dbc04b5b13 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.193836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 102/209] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:08.197185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e123f-b833-419f-92a7-08a825b17eab None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.197718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e123f-b833-419f-92a7-08a825b17eab None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.197791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e123f-b833-419f-92a7-08a825b17eab None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.199303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.199594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.199855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.203233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 108/210] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:08.212248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.212248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.212248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.228711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:08.229928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:08.231336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:08.233733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:08.318591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 103/211] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:08.326186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 109/212] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:08.592857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:08.596168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:08.625949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:08.657115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:08.703131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac52c8-b0eb-4ebe-b80a-0f660bb78b46 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:08.708497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17c63a-16ed-442d-85d0-d9bf1e51df0d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:08.740177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:08.741199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.741704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.742331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.748871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:08.749512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.749794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.750101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.751236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:08.752682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:08.755102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 110/213] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:08.756139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:08.760268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:08.763138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:08.764267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:08.765050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:08.767404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 104/214] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:08.773651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:08.874359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:08.880058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88e49c-6feb-4b14-91f4-fefec1c17875 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:08.882435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff340958-575c-48c1-ac4b-83ef9f6ac026 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:08.905810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:08.920101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:08.920678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:08.920796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.920984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.921260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.921948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:08.922231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:08.922705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:08.923162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:08.923381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:08.924211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:08.924722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:08.926822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:08.940950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 105/215] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:08.943725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:08.950557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 111/216] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:08 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:40:09.060841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39691f7-4b77-4175-97a5-c8c3ddcc48ca None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:09.099860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:09.100523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.100809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.101085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] PATH_INFO: `/v3/users/a4e8553dc7ce437ea593696618597cfe` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.117129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] RBAC: Authorizing `identity:get_user(user_id=a4e8553dc7ce437ea593696618597cfe)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:09.118649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c980d1-e74a-4e5c-a556-86c8d93f5eec None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:09.120851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 106/217] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:08 2022] GET /identity/v3/users/a4e8553dc7ce437ea593696618597cfe => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:09.127807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:09.248443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b0831-d6af-4e91-b1df-8ac3729a6066 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:09.298948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:09.299579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.299931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.300220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.303435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac2b-a2d4-489d-aaac-9b117042ddb8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.303725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac2b-a2d4-489d-aaac-9b117042ddb8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.304003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ac2b-a2d4-489d-aaac-9b117042ddb8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.305536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 107/218] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:09.311210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.311496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.311773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.336352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:09.337568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:09.343869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:09.357991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:09.384366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:09.385803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:09.424047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 108/219] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:09.495728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 112/220] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:09.501191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:09.638122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcd452-f985-47f4-808f-c91e1a5388de None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:09.683607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:09.684320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.684601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.684874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.686077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:09.687515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb54cd-4a74-420b-bd74-8c1de0cbb38b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:09.690198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 109/221] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:09 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:09.695407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:09.726745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5695-5c72-4187-9cd7-e9d08d3be76d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.727047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5695-5c72-4187-9cd7-e9d08d3be76d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.727310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da5695-5c72-4187-9cd7-e9d08d3be76d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.729024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 110/222] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:09.729844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5695-5c72-4187-9cd7-e9d08d3be76d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:09.743446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:09.806979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:09.832293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e909b-1783-4a96-910a-b5d3f1d36b37 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:09.855934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da5695-5c72-4187-9cd7-e9d08d3be76d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:09.875554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:09.876315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.876776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.877140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.878127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=a4e8553dc7ce437ea593696618597cfe) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:09.878786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:09.881879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9d5a6-c1b2-420f-8bbf-6724520fee8d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:09.891395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 113/223] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:09 2022] GET /identity/v3/role_assignments?user.id=a4e8553dc7ce437ea593696618597cfe&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1620c8d7a29041378a32461a8cde3643 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:09.892556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.892838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.893111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.911123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:09.913018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:09.913307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:09.913586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:09.936646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:09.937470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:09.937820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:09.943949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:09.944955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:09.945778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:09.948269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 111/224] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:09.955005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.015870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 114/225] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:10.084284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:10.137295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069edf2d-8ef0-43f2-a455-4d046c39f5fd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.177793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.178382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.178668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.178944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.179624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:10.179933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:10.181335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:10.190848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 112/226] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:10.196504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.287007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:10.334226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2444451-f3b2-4888-9474-cd6c3b6b277c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.366772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.379173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.380113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.380673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.381158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.382549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:10.384196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:10.386388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 115/227] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:10 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:10.399748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.552570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ceb12a-8d59-4586-9b19-7cf9501be0b5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.588155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a73e0e7-337d-404c-ab35-075bb756469b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.607085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:10.627542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.628244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.628524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.628795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.644950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.645605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.645915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.646190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.650138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:10.654473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:10.657104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:10.658129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:10.659000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:10.660473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:10.661090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 116/228] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:10 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:10.662869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 113/229] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:10.665960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.668850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.677258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:10.812112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53803016-1c2b-46d3-9b53-2fdbe950aa6d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.836531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0167e2b-bcd1-4358-9e5a-4e77735f2364 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:10.877784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.878507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.878793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.879076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.879749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:10.880060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:10.881510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:10.890262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:10.890936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:10.891292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 114/230] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:10.895931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:10.896075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/bf996c8ead3446839dfc7b7b73b6a354/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:10.896852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:10.898124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, user_id=bf996c8ead3446839dfc7b7b73b6a354, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:10.899558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:10.937945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 117/231] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:40:10 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/bf996c8ead3446839dfc7b7b73b6a354/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:40:10.971289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:11.044045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e0c9d9-74ea-4095-a3fd-9683508d0b70 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:11.081848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:11.082468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.082761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.083042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.084338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:11.085838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:11.087983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 115/232] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:10 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:11.093654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:11.172387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:11.215271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687a1e54-e1d8-40f8-913b-35eab1b40e7a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:11.252128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:11.252778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.253128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.253405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.262798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:11.264551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82219f1e-89d4-4cbd-9525-4e63847df445 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:11.266626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 118/233] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:11 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:11.273315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:11.403142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e712b3b-db75-4a6c-9b55-4daa8469ff93 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:11.428779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:11.451711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:11.452458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.452748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.453084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/bf996c8ead3446839dfc7b7b73b6a354/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.456552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, user_id=bf996c8ead3446839dfc7b7b73b6a354, role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:11.458591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73977251-e13b-4968-9407-a71d12e83107 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:11.480440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 116/234] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:40:11 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/bf996c8ead3446839dfc7b7b73b6a354/roles/1ef4118652b24050b863bd53ae59decc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:40:11.710175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d112-df0e-4ae0-bea8-935fea58bf69 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.710703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d112-df0e-4ae0-bea8-935fea58bf69 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.710703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb0d112-df0e-4ae0-bea8-935fea58bf69 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.711983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 119/235] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:11.718051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430798a-6e64-4223-aad6-b7ce84c8828d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.718479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430798a-6e64-4223-aad6-b7ce84c8828d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.718852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430798a-6e64-4223-aad6-b7ce84c8828d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.739782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b430798a-6e64-4223-aad6-b7ce84c8828d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:11.740992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b430798a-6e64-4223-aad6-b7ce84c8828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:11.815111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 117/236] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:11.974126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e3c6-b1dd-49a3-b70e-41eb18bd41d9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.974327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e3c6-b1dd-49a3-b70e-41eb18bd41d9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.974710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4e3c6-b1dd-49a3-b70e-41eb18bd41d9 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:11.976484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 120/237] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:11.982240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:11.982550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:11.982799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.002237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:12.003988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:12.103240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 118/238] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:12.108718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e3c6-b1dd-49a3-b70e-41eb18bd41d9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.271798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4e3c6-b1dd-49a3-b70e-41eb18bd41d9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:12.331871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:12.332514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.332799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.333072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.340314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:12.353660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:12.362706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:12.363583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:12.364370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:12.366645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 121/239] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:12.375016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.443892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.450564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:12.570076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad57b88-646a-4fdb-ade5-41804ad76e00 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:12.570689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f317e-de12-4fdf-9872-5d98d2c5af20 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:12.626745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:12.627392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.627675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.628476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.629836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:12.631308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:12.633064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 122/240] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:12.638258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.649035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:12.649685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.649990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.650639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.651387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:12.652004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:12.653682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:12.670060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 119/241] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:12.678621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.774317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:12.845704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb957f-0ef9-4128-8458-60b9bbdb0053 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:12.863794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45353b3b-5bbd-4ebe-bb47-6cfa8aabbb3d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:12.865334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:12.907018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:12.907931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.908220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.908504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] PATH_INFO: `/v3/users/abae13783fc841b7bfe6e5b9bc9cc832` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.914403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:12.915314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.915818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.916289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.917142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:12.918800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff2a6c-c094-4dca-8911-6a7c0cdce621 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:12.923593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] RBAC: Authorizing `identity:get_user(user_id=abae13783fc841b7bfe6e5b9bc9cc832)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:12.925588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c38ee3-eea6-4cdf-bbdd-bfbbee0e34be None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:12.927792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 120/242] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:12 2022] GET /identity/v3/users/abae13783fc841b7bfe6e5b9bc9cc832 => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:12.930979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0341-aa03-4f4c-995c-c1158ba1dd6c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.931480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0341-aa03-4f4c-995c-c1158ba1dd6c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.932016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f0341-aa03-4f4c-995c-c1158ba1dd6c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:12.934572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 121/243] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:12.938693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0341-aa03-4f4c-995c-c1158ba1dd6c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:12.961962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 123/244] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:12 2022] POST /identity/v3/users => generated 293 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:12.963714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:12.964193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:12.964668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.006973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:13.008517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:13.075775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f0341-aa03-4f4c-995c-c1158ba1dd6c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:13.123221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:13.124787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.125251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.125692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.164832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:13.191989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 124/245] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:13.218952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:13.220725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:13.326143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 122/246] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:13.331730 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:13.385609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:13.440375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6276bab-dc64-4cd2-af2b-833b4517fb5c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:13.476798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:13.477496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.477848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.478159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.479354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:13.480852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:13.482720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 125/247] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:13 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:13.489010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:13.502141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:13.565361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:13.620776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324b919-6759-4ec7-8b0f-56c70fbb8297 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:13.640803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f478d-7ed1-4849-9393-ab1809c03d9a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:13.668509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:13.676346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:13.676979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.677310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.678835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.679580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=abae13783fc841b7bfe6e5b9bc9cc832) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:13.679893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:13.681349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc9c81-68b3-4920-b585-acf6607b18e9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:13.687587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 123/248] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:13 2022] GET /identity/v3/role_assignments?user.id=abae13783fc841b7bfe6e5b9bc9cc832&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:13.702322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:13.703448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.703933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.704435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.719311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc97e-3c63-4d15-9e14-d06f9b2326be None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.719620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc97e-3c63-4d15-9e14-d06f9b2326be None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.719875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdc97e-3c63-4d15-9e14-d06f9b2326be None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.720578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:13.721647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 124/249] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:13.726284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:13.727260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:13.728066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:13.730073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 126/250] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:13.732071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.732439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.732808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.740147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:13.757230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:13.758649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:13.850397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 125/251] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:13.866877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d4f4f-7906-4b71-9ef3-0952657467db None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:13.905524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:13.906444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:13.906902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:13.907368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:13.908282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:13.908775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:13.911009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:13.920039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 127/252] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:13.926060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:13.993648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:14.046806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1a86-91d9-4e6f-8833-71b1ca068be8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.089354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:14.090413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.090895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.091381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] PATH_INFO: `/v3/users/a4e8553dc7ce437ea593696618597cfe` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.092760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] RBAC: Authorizing `identity:get_user(user_id=a4e8553dc7ce437ea593696618597cfe)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:14.094445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:14.096241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 126/253] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:13 2022] GET /identity/v3/users/a4e8553dc7ce437ea593696618597cfe => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:14.102574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:14.159797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:14.171001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:14.232234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a3e1-fbac-423b-a658-264089bd741b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.279214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:14.280688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.281679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.282054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.285605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:14.287151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf9746-fb8b-459b-84df-6eadf0550242 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:14.293453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 128/254] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:14 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:14.294775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933e97-9c66-40ac-86b7-c780b147d33e None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.295065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933e97-9c66-40ac-86b7-c780b147d33e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.295345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e933e97-9c66-40ac-86b7-c780b147d33e None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.296587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 129/255] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:14.297265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e933e97-9c66-40ac-86b7-c780b147d33e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:14.368231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8a8fa-707e-4612-970e-8b6dddd7800c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.404420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:14.446719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:14.447299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.447582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.447857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.462435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e933e97-9c66-40ac-86b7-c780b147d33e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.474492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:14.482219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f27f3882-27b9-4e88-93a8-8379b2ab00c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:14.483710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:14.484607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:14.485449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 127/256] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:14.486175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.486712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.486815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.526546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:14.527759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:14.530318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:14.530992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.531332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.531613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/a4e8553dc7ce437ea593696618597cfe/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.534644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, user_id=a4e8553dc7ce437ea593696618597cfe, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:14.538042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:14.561353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 130/257] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:40:14 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/a4e8553dc7ce437ea593696618597cfe/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:14.562040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:14.685607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 128/258] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:14.755312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6475c-8226-4845-b0ae-c111df7680b2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.807031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:14.807982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:14.808273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:14.808549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:14.809228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:14.809535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:14.811227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:14.822966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 131/259] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:14.828864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:14.970778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa506a4-3e9b-438c-bc34-940b2c0cc41c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:14.984030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:15.012045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:15.012613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:15.012895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:15.013170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:15.014609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:15.016063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:15.017649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 129/260] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:14 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:15.023854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:15.090237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:15.149078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:15.177954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f149f-46c5-43bd-b4a1-79cac5fefdd2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:15.233708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:15.234360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:15.234645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:15.234923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:15.331951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec5dc12-b67a-42f2-87e9-6db8cdb625fd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:15.395519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:15.396179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:15.396468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:15.396745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:15.413958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:15.419858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:15.420723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:15.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:15.422711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:15.422711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:15.429221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 130/261] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:15.430746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:15.474815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:15.514434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:15.618258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 132/262] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:15.627470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:15.655899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba37470-58b8-4771-80f6-6f8f55dd4fed None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:15.730675 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:15.731791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:15.733528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:15.735283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:15.736164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:15.736667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:15.739311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:15.764107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 131/263] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:15.783223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:15.820132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75140-0b65-4952-864e-513ecb8cd833 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:15.851525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:15.865770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:15.866742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:15.867223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:15.867694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:15.869096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:15.870787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:15.878010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 133/264] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:15.879169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:16.000717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6e118-2f7c-4ac6-97bc-86c03b14688c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:16.002385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:16.031714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd366238-5b08-4efd-9d54-8ab4e2d61148 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:16.086622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:16.087288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.087572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.087852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] PATH_INFO: `/v3/users/bf996c8ead3446839dfc7b7b73b6a354` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.089043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] RBAC: Authorizing `identity:get_user(user_id=bf996c8ead3446839dfc7b7b73b6a354)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:16.090543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:16.090923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:16.091540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.091824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.092135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 132/265] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/users/bf996c8ead3446839dfc7b7b73b6a354 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:16.092379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.093293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=bf996c8ead3446839dfc7b7b73b6a354) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:16.093742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:16.095328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:16.098654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:16.110206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 134/266] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:15 2022] GET /identity/v3/role_assignments?user.id=bf996c8ead3446839dfc7b7b73b6a354&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:16.265696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb87af3-b7d6-4c70-be28-3a17c3723ecf None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:16.318651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:16.319291 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.319577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.319850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.375837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:16.420924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:16.422509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bf18c1-4268-4613-9b06-10f45e46bcdc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:16.534771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 133/267] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:16.540953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:16.635118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:16.693366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e875b0-9028-4dfe-8a49-4350216be815 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.693892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e875b0-9028-4dfe-8a49-4350216be815 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.694003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e875b0-9028-4dfe-8a49-4350216be815 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.696290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 134/268] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:16.697177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7254658-1b8d-460a-9988-29746a107d2c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:16.705228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699801-b3ec-455a-97ae-87281cb79a19 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.705919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699801-b3ec-455a-97ae-87281cb79a19 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.706547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba699801-b3ec-455a-97ae-87281cb79a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.735565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ba699801-b3ec-455a-97ae-87281cb79a19 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:16.736909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:16.737603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ba699801-b3ec-455a-97ae-87281cb79a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:16.738278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.738734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.739148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.740437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:16.742066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72318e0d-6c33-4a8b-88a8-cb9dfecb2997 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:16.748770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 135/269] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:16 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:16.750394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab96a3-07bf-4658-aabf-1d0717927c09 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.750883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab96a3-07bf-4658-aabf-1d0717927c09 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.751334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab96a3-07bf-4658-aabf-1d0717927c09 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.752892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 136/270] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:16.758367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab96a3-07bf-4658-aabf-1d0717927c09 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:16.840245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:16.848954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 135/271] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:16.850884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ffc34-17cb-4c10-97b6-24c71f74856c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.851322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ffc34-17cb-4c10-97b6-24c71f74856c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.851740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ffc34-17cb-4c10-97b6-24c71f74856c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.882550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-155ffc34-17cb-4c10-97b6-24c71f74856c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:16.885453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-155ffc34-17cb-4c10-97b6-24c71f74856c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:16.930491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab96a3-07bf-4658-aabf-1d0717927c09 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:16.966336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:16.970285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:16.971219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.971740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.972246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.973153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=bf996c8ead3446839dfc7b7b73b6a354) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:16.973643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:16.975533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c843e-2173-4487-8b18-071c61348090 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:16.982082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 137/272] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:16 2022] GET /identity/v3/role_assignments?user.id=bf996c8ead3446839dfc7b7b73b6a354&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1ef4118652b24050b863bd53ae59decc => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:16.983545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187860a1-7978-45ae-b020-ba1c678088be None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.983655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 136/273] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:16.984138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187860a1-7978-45ae-b020-ba1c678088be None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.984633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187860a1-7978-45ae-b020-ba1c678088be None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:16.990566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 138/274] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:16.995393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:16.995977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:16.996494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.017428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:17.019640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:17.105168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 137/275] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:17.129320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187860a1-7978-45ae-b020-ba1c678088be None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.263250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187860a1-7978-45ae-b020-ba1c678088be None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.302692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.303713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.304211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.304685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.306108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:17.307820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:17.309612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 139/276] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:17.315997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.347761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.397464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:17.423667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:17.452961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510efa02-f995-4623-b70a-1c1478d33673 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.473533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925bd8c4-fc14-4de4-b8c6-3a82b654e6b4 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.499007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.499783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.499894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.500171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.500838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:17.502327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:17.518689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.519709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.520165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.520583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.525729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 138/277] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:17 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:17.526745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.535066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:17.542904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:17.543950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:17.544778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:17.547173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 140/278] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:17.553477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.667339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bcbde-c85f-4aa7-8d91-d3624085b6fa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.680822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c0456-f8d1-47e5-961e-9a5f24011d07 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.690766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:17.717148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:17.719000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.719991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.719991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.720183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.736902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:17.739691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.740309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.740592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.740867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.741537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:17.741843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:17.742576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:17.743471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:17.744310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:17.744928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:17.744998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 139/279] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:17.749559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.757996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 141/280] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:17.763338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.877725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689a9fb-f8ff-4e69-a4ad-196e198c5b05 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.897024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081030fa-4b81-4d28-914e-ab2063489403 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:17.929001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.929189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.929433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.929708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.930499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:17.930811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:17.932372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c874b-40e4-4be3-95d8-65a81d6db62c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:17.939436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:17.940082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.940435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.940714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] PATH_INFO: `/v3/users/e1de6571c9664d9caf04f82b255c5552` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.945997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 140/281] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:17.947386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c281-9c82-4d35-91dd-23e0911071a1 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.947696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c281-9c82-4d35-91dd-23e0911071a1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.947968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d636c281-9c82-4d35-91dd-23e0911071a1 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.949271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 141/282] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:17.950712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c281-9c82-4d35-91dd-23e0911071a1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:17.956609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] RBAC: Authorizing `identity:get_user(user_id=e1de6571c9664d9caf04f82b255c5552)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:17.958112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ebc9c-46ef-45ee-8ebd-72061aaa24d2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:17.960597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 142/283] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/users/e1de6571c9664d9caf04f82b255c5552 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:17.966285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:17.966808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:17.967322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:17.989928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:17.990940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:18.017792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.054255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.068061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 143/284] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:18.069070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.104682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d636c281-9c82-4d35-91dd-23e0911071a1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.167965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.168616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.168903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.169179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] PATH_INFO: `/v3/users/abae13783fc841b7bfe6e5b9bc9cc832` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.175093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] RBAC: Authorizing `identity:get_user(user_id=abae13783fc841b7bfe6e5b9bc9cc832)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.176567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.178519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 142/285] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:17 2022] GET /identity/v3/users/abae13783fc841b7bfe6e5b9bc9cc832 => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:18.184803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.247337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f431a-36fa-45dc-8ee0-ef1f99a2262b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.290887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.291569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.291855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.292131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.293446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, user.id=e1de6571c9664d9caf04f82b255c5552, scope.system=all) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:18.293758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.295518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.301092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 144/286] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/role_assignments?user.id=e1de6571c9664d9caf04f82b255c5552&scope.system=all&role.id=1620c8d7a29041378a32461a8cde3643 => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:18.398187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e8529c-c43a-4913-b0cb-eee26819814f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.406360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.446394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.446962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.447240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.447519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.454748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.456378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.458326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 143/287] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:18.462178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.463856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.510350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.579359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b2aa5-30bb-4f28-b3b1-c59fbfbcd59c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.617567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.618341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.618624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.618934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.633892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:18.636539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:18.637421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:18.638617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 145/288] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:18.644325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.660591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78989649-9785-4542-b597-fdcb2ed9a78a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.740894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.742366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.742857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.743392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/abae13783fc841b7bfe6e5b9bc9cc832/roles/7a01b6b970cf4271a9941bbdd64a6909` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.751262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, user_id=abae13783fc841b7bfe6e5b9bc9cc832, role_id=7a01b6b970cf4271a9941bbdd64a6909)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.753161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.753704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.759793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c011f1c-7e93-4311-8558-b16fbb72f75b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.786612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 144/289] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:40:18 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/users/abae13783fc841b7bfe6e5b9bc9cc832/roles/7a01b6b970cf4271a9941bbdd64a6909 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:40:18.800970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.801604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.801897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.802178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.802869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:18.803176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.804670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.815177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 146/290] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:18.821143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:18.872581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:18.940363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40efdc-6bed-4f30-be3f-c697fb8f05ca None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:18.978029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:18.978686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:18.978969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:18.979244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] PATH_INFO: `/v3/users/a4e8553dc7ce437ea593696618597cfe` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:18.980458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] RBAC: Authorizing `identity:get_user(user_id=a4e8553dc7ce437ea593696618597cfe)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:18.982069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:18.984092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 145/291] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/users/a4e8553dc7ce437ea593696618597cfe => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:18.990552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:19.095771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d64e-f8fc-4271-97ab-1685b41a0dd0 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:19.131265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:19.131878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:19.132169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:19.132445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:19.160620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:19.202624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:19.204097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:19.307031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 147/292] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:19.312662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:19.427320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179fba37-f3d9-4683-99f8-968ee472c8ed None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:19.428804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:19.481636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de87b227-e605-4222-8108-f76705538d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:19.482363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b227-e605-4222-8108-f76705538d4c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:19.482650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b227-e605-4222-8108-f76705538d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:19.482925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de87b227-e605-4222-8108-f76705538d4c None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:19.484139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b227-e605-4222-8108-f76705538d4c None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:19.485627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de87b227-e605-4222-8108-f76705538d4c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:19.487710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 146/293] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:19 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:19.493778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:19.562241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:19.596627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6f38ec-e4e4-426d-ad8f-2c99c6b9712a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:19.631653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:19.632341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:19.632625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:19.632896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:19.633679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=a4e8553dc7ce437ea593696618597cfe) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:19.634082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:19.635530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5467c061-3f60-4d38-8cd5-21ae955da3bd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:19.642044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 148/294] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:19 2022] GET /identity/v3/role_assignments?user.id=a4e8553dc7ce437ea593696618597cfe&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1620c8d7a29041378a32461a8cde3643 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:20.311496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08a06-36fb-4f78-b443-65831e2230e6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.312030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08a06-36fb-4f78-b443-65831e2230e6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.312030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d08a06-36fb-4f78-b443-65831e2230e6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.313396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 147/295] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:20.318876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.319369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.338148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:20.339339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:20.386031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bee5d-7a8d-4f7f-8d04-7638553c1798 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.386667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bee5d-7a8d-4f7f-8d04-7638553c1798 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.387178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bee5d-7a8d-4f7f-8d04-7638553c1798 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.389211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 148/296] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:20.394913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.395427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.395911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.409353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 149/297] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:20.417918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:20.417918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:20.484985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 149/298] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:20.675450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:20.731456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:20.775547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:20.788276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d03893-7590-45f2-bf97-44349b55aa25 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:20.832331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:20.832976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.833357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.833651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.848386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:20.854040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:20.854922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:20.855714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:20.858549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 150/299] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:20.864293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:20.887403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:20.890686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689f7f9-e519-4b81-aabf-ce8ec0877cb6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:20.928682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:20.929587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.930079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.930572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.931984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:20.933663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42991ec8-105e-4064-8ff8-b2ffae710f69 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:20.935798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 150/300] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:20.937287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c77-0e19-449e-9527-fe667ba1a81d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:20.937717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c77-0e19-449e-9527-fe667ba1a81d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:20.938224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c624c77-0e19-449e-9527-fe667ba1a81d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:20.939711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 151/301] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:20.941721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624c77-0e19-449e-9527-fe667ba1a81d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:20.978096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511ae680-d35e-4047-96be-8eebeded44f2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:20.991895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.016418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.017027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.017475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.017748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.018983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:21.019289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.021072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b422-b522-4dd4-aedf-a609d15663e7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.029352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 151/302] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:21.030844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.031134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.031409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.050944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c624c77-0e19-449e-9527-fe667ba1a81d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.051245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:21.052534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:21.085433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.086076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.086366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.086639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] PATH_INFO: `/v3/groups` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.087278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.088731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.105569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 152/303] 10.222.0.33 () {60 vars in 1134 bytes} [Fri Sep 16 01:40:20 2022] POST /identity/v3/groups => generated 229 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:21.115342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.127399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 152/304] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:21.152447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.236457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302a0c-2e07-4813-8dbb-0220b2ac47b4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.277210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.277887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.278173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.278453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] PATH_INFO: `/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.294720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] RBAC: Authorizing `identity:get_user(user_id=eb23ff6b5e0d48b8b8bf4cccd9d0c268)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.296203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.298082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 153/305] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:21.304622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.415514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d131bb8c-be5e-4914-bb78-1db04e3f2785 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.417913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.422343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.453784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.454434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.454708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.454979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.455775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, user.id=eb23ff6b5e0d48b8b8bf4cccd9d0c268, scope.system=all) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:21.456089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.457646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e04a03-72bc-436e-8c94-205ff5d2a00b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.466336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 153/306] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/role_assignments?user.id=eb23ff6b5e0d48b8b8bf4cccd9d0c268&scope.system=all&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:21.466336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d44792-09fa-4e98-af5c-3911e6599d53 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.466336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d44792-09fa-4e98-af5c-3911e6599d53 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.466336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d44792-09fa-4e98-af5c-3911e6599d53 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.466336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 154/307] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:21.472340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.472635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.472893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.493277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:21.494452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:21.529283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.548231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd4580-5a79-49e6-950c-7d152a6671a4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.588523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 155/308] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:21.590304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.590989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.591273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.591548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.604263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:21.609395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:21.610457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:21.611836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 154/309] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:21.619061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.728764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.733899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3404-859b-413f-93c4-491e752aeff2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.769839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.770527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.770810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.771083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.771749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:21.772055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.773407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.782216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 156/310] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:21.787798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.881727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.901777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf51f0-4c82-4839-8f78-b73eeb2dde71 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:21.942538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:21.948534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:21.948801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:21.949072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] PATH_INFO: `/v3/users/e1de6571c9664d9caf04f82b255c5552` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:21.950357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] RBAC: Authorizing `identity:get_user(user_id=e1de6571c9664d9caf04f82b255c5552)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:21.952070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:21.959023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 155/311] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/users/e1de6571c9664d9caf04f82b255c5552 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:21.959842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:21.977413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:21.996007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1beb4-9874-448e-a79f-966b6034d7bb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.034257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.035212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.035712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.036200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.047184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:22.053731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:22.054648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:22.055439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:22.059530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 157/312] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:22.064258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:22.077934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb71f-88ef-47c7-8b78-23705149326a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.113801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:22.119155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.120314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.120598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.120886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] PATH_INFO: `/v3/system/users/e1de6571c9664d9caf04f82b255c5552/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.122714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e1de6571c9664d9caf04f82b255c5552, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:22.124446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:22.137105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 156/313] 10.222.0.33 () {58 vars in 1334 bytes} [Fri Sep 16 01:40:21 2022] PUT /identity/v3/system/users/e1de6571c9664d9caf04f82b255c5552/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:22.196753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50771bda-6bcf-4e31-bc15-89270d5f84a5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.237536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.238246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.238534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.238873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.239623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:22.239936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:22.241338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:22.251339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 158/314] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:22.262085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:22.366908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:22.395061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb04e2d-57f3-4cc2-9152-077346255a2e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.432257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.433701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.434209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.434657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] PATH_INFO: `/v3/users/abae13783fc841b7bfe6e5b9bc9cc832` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.436046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] RBAC: Authorizing `identity:get_user(user_id=abae13783fc841b7bfe6e5b9bc9cc832)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:22.437815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:22.440680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 157/315] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:22 2022] GET /identity/v3/users/abae13783fc841b7bfe6e5b9bc9cc832 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:22.446655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:22.547790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:22.573292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d18c3d-f15f-416b-a1cb-3bde3cef105c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.612661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.613278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.613563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.613922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.693457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:22.694883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:22.795629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:22.809067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 159/316] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:22.819002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:22.930268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbde77-0a75-4b5a-81a4-9020e7bdf38d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:22.967209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:22.968168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:22.968668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:22.969284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:22.970636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:22.972879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad205b4-509b-4a28-9290-15c0ae2dd6f3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:22.975078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 158/317] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:22 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:22.981261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:23.095330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bd7a1-03da-4962-ac59-062a2b66de1d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:23.134282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:23.134914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.135195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.135469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.136219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, scope.project.id=7134c0dad1564973aeb9696c872b6a91, user.id=abae13783fc841b7bfe6e5b9bc9cc832) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:23.136532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:23.138039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e96d0b-c954-4423-95ce-2859429866f5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:23.146071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 160/318] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:22 2022] GET /identity/v3/role_assignments?user.id=abae13783fc841b7bfe6e5b9bc9cc832&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:23.449899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a961-32d1-431b-9bff-aec8315c6b7b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.450450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a961-32d1-431b-9bff-aec8315c6b7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.450450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a961-32d1-431b-9bff-aec8315c6b7b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.451950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 159/319] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:23.457126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa881bd-db50-41c4-8dc3-26d052f98fd7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.457532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa881bd-db50-41c4-8dc3-26d052f98fd7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.457694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa881bd-db50-41c4-8dc3-26d052f98fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.475659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0fa881bd-db50-41c4-8dc3-26d052f98fd7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:23.476857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0fa881bd-db50-41c4-8dc3-26d052f98fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:23.523321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:23.550522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 161/320] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:23.732862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537ed5-c2d4-4ecd-9099-aafd1e4185c7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.733234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537ed5-c2d4-4ecd-9099-aafd1e4185c7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.733425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02537ed5-c2d4-4ecd-9099-aafd1e4185c7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.734932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 160/321] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:23.740059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.740353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.740630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.759043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:23.760221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:23.819217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537ed5-c2d4-4ecd-9099-aafd1e4185c7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:23.825814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 162/322] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:23.835600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:23.922628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02537ed5-c2d4-4ecd-9099-aafd1e4185c7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:23.957480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:23.958197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:23.958482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:23.958760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:23.959910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:23.961473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:23.963288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 161/323] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:23.968652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:24.072935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de244243-1fec-4201-a61f-5c3377cbf09a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:24.080175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:24.095319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:24.113811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:24.114940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.115690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.116153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] PATH_INFO: `/v3/groups` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.116979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:24.119076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:24.139752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 163/324] 10.222.0.33 () {60 vars in 1134 bytes} [Fri Sep 16 01:40:23 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:40:24.187858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:24.210340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d32bd7f-e3fc-4a30-856e-af161d2b90f0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:24.247628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:24.248276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.248554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.248826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.261989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:24.267869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:24.268840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:24.269678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 162/325] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:24.275175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:24.392207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fba5a1-0ed2-4d40-937b-e993aad2a611 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:24.430630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:24.431252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.431531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.431803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.432473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:24.432778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:24.434230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe8865-e66e-4b51-b9b9-e5bf772c35f6 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:24.445546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 164/326] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:24.450246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:24.500504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82ba77-d8e0-4ae2-9e88-0f0a65303ed8 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.501017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82ba77-d8e0-4ae2-9e88-0f0a65303ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.501092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a82ba77-d8e0-4ae2-9e88-0f0a65303ed8 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.503559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 165/327] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:24.508241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.508533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.508816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.529067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:24.530539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:24.559652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:24.572191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47708fd-b21f-4cb8-b8f7-8e2722a48a0b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:24.610964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:24.611721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.612104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.612467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] PATH_INFO: `/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.613888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] RBAC: Authorizing `identity:get_user(user_id=eb23ff6b5e0d48b8b8bf4cccd9d0c268)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:24.615368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:24.617391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 163/329] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:24 2022] GET /identity/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:24.621929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 166/329] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:24.623249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:24.638030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:24.735091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf2a4-897b-4efc-bb7e-6355e019d78c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:24.772381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:24.773091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:24.773378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:24.773658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] PATH_INFO: `/v3/system/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268/roles/7a01b6b970cf4271a9941bbdd64a6909` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:24.775357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=eb23ff6b5e0d48b8b8bf4cccd9d0c268, role_id=7a01b6b970cf4271a9941bbdd64a6909)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:24.776761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:24.786580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 164/330] 10.222.0.33 () {58 vars in 1334 bytes} [Fri Sep 16 01:40:24 2022] PUT /identity/v3/system/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268/roles/7a01b6b970cf4271a9941bbdd64a6909 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:40:24.916319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:25.033067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b0ac1f-cd2f-440c-9a7f-2eecb16ec490 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:25.076217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:25.076862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:25.077146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:25.077422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:25.089318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:25.094449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:25.095355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:25.096697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 167/331] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:25.103728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:25.191533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:25.221836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b4428-23ce-4066-a2c6-f9e3646c78dc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:25.277017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:25.277672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:25.277985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:25.278326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:25.279034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:25.279347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:25.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:25.292696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 165/332] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:25.298718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:25.319424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:25.409230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780407ae-c641-43a3-9165-f7812ce0bf0e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:25.447743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:25.448385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:25.448670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:25.448944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] PATH_INFO: `/v3/users/e1de6571c9664d9caf04f82b255c5552` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:25.450121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] RBAC: Authorizing `identity:get_user(user_id=e1de6571c9664d9caf04f82b255c5552)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:25.451561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba5dc2e-91db-40d3-8b0c-e4ff7f9548c2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:25.453598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 168/333] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:25 2022] GET /identity/v3/users/e1de6571c9664d9caf04f82b255c5552 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:25.459616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:25.588754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6388e-6d12-4b3c-95ca-89e9661ba572 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:25.635559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:25.636185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:25.636460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:25.636737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:25.637474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] RBAC: Adding query filter params (role.id=1620c8d7a29041378a32461a8cde3643, user.id=e1de6571c9664d9caf04f82b255c5552, scope.system=all) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:25.637796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:25.639545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bedf6-e1c9-4d83-8efa-2db1c661792d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:25.644631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:25.656094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 166/334] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 01:40:25 2022] GET /identity/v3/role_assignments?user.id=e1de6571c9664d9caf04f82b255c5552&scope.system=all&role.id=1620c8d7a29041378a32461a8cde3643 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:26.769914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5c87-4c9f-4767-927a-06f80de58ed9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:26.770430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5c87-4c9f-4767-927a-06f80de58ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:26.770529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032b5c87-4c9f-4767-927a-06f80de58ed9 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:26.772092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 169/335] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:26.777346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381079cc-810a-4406-88d9-31187a93516e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:26.778256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381079cc-810a-4406-88d9-31187a93516e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:26.778739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381079cc-810a-4406-88d9-31187a93516e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:26.798768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-381079cc-810a-4406-88d9-31187a93516e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:26.800344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-381079cc-810a-4406-88d9-31187a93516e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:26.880219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 167/336] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:27.250118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d796d-b15e-4afa-8fed-24948d5c63d3 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:27.250776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d796d-b15e-4afa-8fed-24948d5c63d3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:27.251341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d796d-b15e-4afa-8fed-24948d5c63d3 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:27.253716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 170/337] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:27.262433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:27.262433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:27.262433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:27.288339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:27.289823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:27.374018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 168/338] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:27.410098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d796d-b15e-4afa-8fed-24948d5c63d3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:27.543961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:27.564436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d796d-b15e-4afa-8fed-24948d5c63d3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:27.607643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:27.608280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:27.608559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:27.608832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:27.624518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:27.629897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:27.630768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:27.631581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:27.633689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 171/339] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:27.639578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:27.734847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:27.802408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826055c-d1b0-4160-b4cb-dd7eb2e108f8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:27.848577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:27.849199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:27.849481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:27.849756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:27.850459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:27.850771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:27.852143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:27.861505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 169/340] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:27.870950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:27.941803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.006100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5260ea8-817e-405b-9905-ce0991eadeab None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.049133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.051023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.051517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.052075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.086857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:28.123543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad79a6-129d-41c3-859a-c1130e40e45c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.158217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:28.178878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.179523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.179808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.180086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.193641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fd8b3e9b-979e-47a7-8f06-caed022749f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:28.199492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:28.200604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:28.201608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:28.204145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 170/341] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:28.205556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999c7b-9e5f-4362-b77a-23839051b70c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.206063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999c7b-9e5f-4362-b77a-23839051b70c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.206173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:28.206573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f999c7b-9e5f-4362-b77a-23839051b70c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.207560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a00963-ba4c-4738-a630-07940e0f7d06 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:28.208482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 171/342] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:28.215406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.215926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.216346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.250976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:28.254149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:28.335888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 172/343] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:28.336661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.348595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 172/344] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:28.350106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319088-383b-4ba8-9c70-2105b3549e3f None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.350598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319088-383b-4ba8-9c70-2105b3549e3f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.351070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319088-383b-4ba8-9c70-2105b3549e3f None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.352514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 173/345] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:28.358789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319088-383b-4ba8-9c70-2105b3549e3f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.430685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:28.477893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319088-383b-4ba8-9c70-2105b3549e3f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.525905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.526569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.526898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.527174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.529083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:28.530747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4416c-e1d7-48b9-8598-8e20ea23f917 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:28.532398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 174/346] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:28 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:28.533550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.533888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.534161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.567308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3d480b-7d49-47c7-a91e-2ff5719d577b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.576111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:28.579625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:28.583335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:28.629993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.630544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.630822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.631094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.631772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:28.634859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:28.636252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:28.658299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 173/347] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:28.659320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.687930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 175/348] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:28.689112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.788750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:28.858528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15ec5-da4b-4a14-b530-9f9a8c67ace7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.897389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a6ff7-fc32-422b-8d9c-3450040c2759 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:28.933135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.933803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.934112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.934391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:28.950494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:28.952005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:28.959723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 174/349] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:28 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:28.960688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:28.975326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:28.976009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:28.976295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:28.976562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.030050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.103487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.105310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.135452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e6be4-d3a9-4c9b-885a-dbdbf834ac4b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.165772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.182453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.183179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.183529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.183811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.196572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:29.202371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:29.203370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:29.204214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 175/350] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:29.204946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.241766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 176/351] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:29.242714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.330189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.342138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb78dc9-4d13-4615-b62c-adc7a124ac04 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.371240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a982c57c-a992-4640-ba79-f8dc9e7a3d11 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.387096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.387299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.387441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.387742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.388543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:29.389140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.390685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb9bdc-f36c-4ab6-aa03-ef300de163fa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.400195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 176/352] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1620c8d7a29041378a32461a8cde3643 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:29.401412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facdeb-54cb-40a4-ae72-87a609ad565d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.402942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facdeb-54cb-40a4-ae72-87a609ad565d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.402942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13facdeb-54cb-40a4-ae72-87a609ad565d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.403219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 177/353] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:29.403950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13facdeb-54cb-40a4-ae72-87a609ad565d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.411689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.412688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.413201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.413730 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.426767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:29.432070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:29.433022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:29.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:29.436389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 177/354] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:29.437544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.448344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.542532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13facdeb-54cb-40a4-ae72-87a609ad565d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.574545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a1d9b-f9e2-40f7-908c-69becd0050d4 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.584598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.584962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.585147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.585439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.586158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:29.586464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.588400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380eb1a-2af5-41c3-8fc8-f9064e8ea3c8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.598688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 178/355] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:29.599844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.600133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.600408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.626760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:29.629409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:29.629788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.630695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.631178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.631650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.634614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.636340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.638387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 178/356] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:29.639625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.645743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.711213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 179/357] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:29.712102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.728724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.769754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fbb18f-bd97-499d-aa64-ba78a856fff3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.819572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.820187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.820471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.820745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.821845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:29.822246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.824392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.836220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 179/358] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:29.842162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.855436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250400-e461-4c26-a7fb-0dbdf2e6e421 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:29.909411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:29.910313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.910977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.911255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] PATH_INFO: `/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.912404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] RBAC: Authorizing `identity:get_user(user_id=eb23ff6b5e0d48b8b8bf4cccd9d0c268)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:29.914426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b32633-9688-4b97-9bc9-b2079fc06702 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:29.922023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 180/359] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/users/eb23ff6b5e0d48b8b8bf4cccd9d0c268 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:29.924589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee1ba-355c-494b-8d19-775d061cc34b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:29.924884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee1ba-355c-494b-8d19-775d061cc34b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:29.925160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ee1ba-355c-494b-8d19-775d061cc34b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:29.927400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 181/360] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:29.928109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee1ba-355c-494b-8d19-775d061cc34b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:29.950063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:29.991547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18670c-6041-4d9c-8e6b-1498108da125 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.046390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.047715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.048151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.048591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.049972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.052085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.054201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 180/361] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.055178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.062157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.074241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ee1ba-355c-494b-8d19-775d061cc34b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.131715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.131944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.132309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.132684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.192233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c03d8-361f-411b-9a8a-a271f361bb9a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.219471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.221015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.241020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.241692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.241977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.242255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.242994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] RBAC: Adding query filter params (role.id=7a01b6b970cf4271a9941bbdd64a6909, user.id=eb23ff6b5e0d48b8b8bf4cccd9d0c268, scope.system=all) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:30.243309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.244746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6a53-2e8a-4938-9fb5-c5bd22e0ffc4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.249663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.261963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 181/362] 10.222.0.33 () {56 vars in 1308 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/role_assignments?user.id=eb23ff6b5e0d48b8b8bf4cccd9d0c268&scope.system=all&role.id=7a01b6b970cf4271a9941bbdd64a6909 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.263332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.263693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.264299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.289432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:30.290860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:30.375706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.379544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 182/363] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:30.380577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.393569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 182/364] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:30.395360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.509623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c487-9d7f-425e-89ed-1c2c949b4aff None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.532512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.542820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad2db1-7e1b-41b0-a1d5-59f8aff8e8b7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.562117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.563088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.563377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.563656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.578685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:30.584679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:30.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:30.586957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 183/365] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:30.587667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.604536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.605481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.606168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.606618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.607875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:30.608389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.610378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.619230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 183/366] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1ef4118652b24050b863bd53ae59decc => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.620642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.696080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.712127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b1d912-4314-4d61-8b66-3fa9619d955b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.749906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.750714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.751118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.751496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.753002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.754701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.756481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 184/367] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.759025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30ceac-7be1-4d79-93a1-1db56bc90360 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.762923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.809782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.810715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.811150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.811584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.813075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:30.813574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.815850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.819921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:30.831048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 184/368] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.836344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.885277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac7f075-6d49-4c72-8863-41658d7a0817 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:30.952164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:30.952934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:30.953146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:30.953419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:30.954664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:30.956690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:30.959167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 185/369] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:30.959954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:30.991161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546fb2b5-003e-44a3-ab4e-3faab9a0f013 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.010371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.030246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.031640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.032277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.032754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.119406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.121814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1af12dc-1f12-4f2f-910b-33e8e26d2fbb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.122709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.137613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.167886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.168882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.169405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.169934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.181274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:31.186554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:31.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:31.188265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:31.191162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 186/370] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:31.197299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.253413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 185/371] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 01:40:31.254531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.318330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.322178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee612b0f-789e-416d-80e0-42709a2a8882 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.371574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.372488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.372970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.373421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.376493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=7134c0dad1564973aeb9696c872b6a91) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:31.377037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.380942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.389095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 187/372] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1620c8d7a29041378a32461a8cde3643 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:31.390375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.401003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a692bbb-8282-4298-bb43-faef827cfa15 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.445913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.448037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.448950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.449380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.449812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.450768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:31.451240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.452769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.465248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 186/373] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:31.471111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.530301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c8336-0ac4-454e-867b-71eb7b2ee927 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.569489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.570432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.570884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.571307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.572729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.574419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.576317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 188/374] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:31.582751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.583904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.592897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9477999d-3f59-473e-9a57-d218402f10d9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.652497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.653127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.653417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.653688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.740020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.741738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.821781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d07f30-71f1-44c5-bfec-7a297f30e896 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:31.831296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.832509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:31.873071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 187/375] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:31.878387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:31.879878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:31.880755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:31.881043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:31.881323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:31.883424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:31.884898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:31.886804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 189/376] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:31.893704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:32.028097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371cb7f-0419-4d43-a77b-56a5c1807e80 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:32.039945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a576fc-aac3-48af-813b-32446b06c99c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:32.066189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:32.066868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.067213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.067488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] PATH_INFO: `/v3/projects/36f275dc1246410f9a8f5e0be2414a85` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.068713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] RBAC: Authorizing `identity:get_project(project_id=36f275dc1246410f9a8f5e0be2414a85)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:32.070316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:32.072324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 188/377] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/projects/36f275dc1246410f9a8f5e0be2414a85 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:32.077909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:32.092022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:32.092718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.093007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.093285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.094066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=7134c0dad1564973aeb9696c872b6a91) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:32.094382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:32.095828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edea50-b236-4d61-8ad0-64d7c32c3226 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:32.102769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 190/378] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:31 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1ef4118652b24050b863bd53ae59decc => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:32.135847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:32.143854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4ef9-21a8-4a8c-a56e-8343deae4906 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.144167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4ef9-21a8-4a8c-a56e-8343deae4906 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.144479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d4ef9-21a8-4a8c-a56e-8343deae4906 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.146081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 191/379] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:32.155630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.155961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.156190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.185053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:32.186376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:32.201778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ff479-ec89-4bc0-9d44-346f75188630 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:32.221226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:32.251104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:32.251824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.252146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.253003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] PATH_INFO: `/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.262996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] RBAC: Authorizing `identity:get_group(group_id=69e552c6e1fa47e5b136b99a84d0c6a0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:32.264732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:32.266874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 189/380] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:32 2022] GET /identity/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:32.273692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:32.294364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 192/381] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:32.417215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07d3bf9-55d3-4ed4-82fd-f3f8ed8cbd69 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:32.434222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:32.460472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:32.461101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.461389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.461669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.462506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] RBAC: Adding query filter params (group.id=69e552c6e1fa47e5b136b99a84d0c6a0, role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=36f275dc1246410f9a8f5e0be2414a85) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:32.462820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:32.464261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:32.470197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 190/382] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:32 2022] GET /identity/v3/role_assignments?group.id=69e552c6e1fa47e5b136b99a84d0c6a0&scope.project.id=36f275dc1246410f9a8f5e0be2414a85&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:32.660429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:32.790425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082e77d-12b3-4571-a76f-b1fcd9cb532b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:32.829815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:32.830584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:32.830865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:32.831139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:32.842140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:32.847619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:32.848512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:32.849318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 193/383] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:32.855681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:32.963980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563e554-ef8b-4b33-9e15-a9fac87fe5a2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:33.000680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:33.001296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.001580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.001860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.002624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:33.002934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:33.004316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:33.013233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 191/384] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:33.019649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:33.049839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:33.127606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486fc4f-6198-442b-980a-a7b1b30e2e91 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:33.164212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:33.164858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.165199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.165479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.166679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:33.168126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:33.169918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 194/385] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:33 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:33.175889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:33.213330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:33.285286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d910929-6d68-4f5d-95c8-8045d772b69e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:33.320297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:33.320854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.321134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.321409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.322639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:33.324126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6860da3-64c6-4d47-ba4e-36f28b664e11 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:33.326163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 192/386] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:33 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:33.332175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:33.436133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:33.444418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ac0f2d-ba56-47be-af35-cb36e2171d3c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:33.481729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:33.482474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.482758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.483084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/groups/269be88411f340db95cec0d172975d13/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.485047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, group_id=269be88411f340db95cec0d172975d13, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:33.486617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5d7cdb-e13e-4983-b4ee-b5020f2869ad None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:33.502760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 195/387] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 01:40:33 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/groups/269be88411f340db95cec0d172975d13/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:33.561237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64331-d63d-4dad-a494-3b6d21e52814 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.561576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64331-d63d-4dad-a494-3b6d21e52814 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.561807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a64331-d63d-4dad-a494-3b6d21e52814 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.563336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 193/388] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:33.569810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856289f9-84d3-4ea3-9a64-a22ebe166ef4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:33.570127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856289f9-84d3-4ea3-9a64-a22ebe166ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:33.570457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856289f9-84d3-4ea3-9a64-a22ebe166ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:33.592425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-856289f9-84d3-4ea3-9a64-a22ebe166ef4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:33.594970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-856289f9-84d3-4ea3-9a64-a22ebe166ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:33.687143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 196/389] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:34.089355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64331-d63d-4dad-a494-3b6d21e52814 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:34.231521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a64331-d63d-4dad-a494-3b6d21e52814 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:34.234067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:34.276275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998d65a-8755-4fab-a090-5c5af074d45b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:34.276681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998d65a-8755-4fab-a090-5c5af074d45b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:34.276860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c998d65a-8755-4fab-a090-5c5af074d45b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:34.278203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 197/390] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:34.287070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:34.287229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:34.287459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:34.287615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:34.287854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:34.288148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:34.288433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:34.299909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:34.306366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:34.307329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:34.308574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 194/391] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:34.316242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:34.321245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:34.322734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:34.420617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 198/392] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:34.504508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa340-63c8-4d3e-a2ea-9f34e9a9bc46 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:34.560399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:34.561010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:34.561294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:34.561570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:34.562267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:34.562575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:34.563942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:34.577014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 195/393] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:34.583303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:34.600696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:34.729124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875765d7-7d98-4b19-ba65-0743cce8b326 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:34.778602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:34.779610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:34.780116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:34.780593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:34.781975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:34.784267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:34.790439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 199/394] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:34 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:34.795877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:34.850579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:34.868620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:34.930590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc87293-b2f2-4e4f-a0d6-4a191feca229 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.002934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:35.019242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574f51e-4d47-4552-af77-de2f737abc70 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.046348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.047018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.047301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.047576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.050022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:35.051453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:35.056157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 196/395] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:34 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:35.058759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.083214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.083860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.084140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.084416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.109197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:35.114305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:35.115227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:35.116051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:35.123488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 200/396] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:35.134808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.231480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:35.245102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccde85b-ef5f-4750-b228-8e23f4774965 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.292085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.292792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.293189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.293476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/groups/269be88411f340db95cec0d172975d13/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.295811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] RBAC: Authorizing `identity:create_grant(project_id=71fcc35e243f47f0b56323cf9a428bc0, group_id=269be88411f340db95cec0d172975d13, role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:35.297323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208d75cd-ca89-4e35-893c-a967d908a490 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:35.314354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 197/397] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 01:40:35 2022] PUT /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0/groups/269be88411f340db95cec0d172975d13/roles/1ef4118652b24050b863bd53ae59decc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:35.325332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3213-880f-4aa7-9f29-fe4d357e1f03 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.325653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3213-880f-4aa7-9f29-fe4d357e1f03 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.327147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf3213-880f-4aa7-9f29-fe4d357e1f03 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.329851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 198/398] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:35.336067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280aa1-9b1b-4aab-9dfc-6c4c586bf628 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.336378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280aa1-9b1b-4aab-9dfc-6c4c586bf628 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.336629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0280aa1-9b1b-4aab-9dfc-6c4c586bf628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.367309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a0280aa1-9b1b-4aab-9dfc-6c4c586bf628 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:35.368546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a0280aa1-9b1b-4aab-9dfc-6c4c586bf628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:35.376487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f42187e-ff6f-4860-9d32-b4c35f30b809 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.452719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.453354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.453732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.454036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.454824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:35.455674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:35.457106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:35.460161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 199/399] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:35.461646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506afa3f-1eac-42a2-aed9-227a63e395a7 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.462057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506afa3f-1eac-42a2-aed9-227a63e395a7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.462455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506afa3f-1eac-42a2-aed9-227a63e395a7 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.467834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 200/400] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:35.469357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.469645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.469948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 201/401] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:35.470054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.476840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.481227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:35.493900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:35.495555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:35.576012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 201/402] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:35.608174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd3bea-8e33-4e35-b51d-872da76b9939 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.647184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.648115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.648544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.648974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.650304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:35.651979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:35.653771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 202/403] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:35 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:35.661624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.698237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:35.818782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.826260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dc0f2-94da-4c45-81c7-83d0e50c3972 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:35.864982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:35.865894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:35.866399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:35.866878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:35.874638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:35.876304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:35.881011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 202/404] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:35 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:35.885177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:35.982286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:35.998854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7adf2-71ad-4d77-a896-a1dec6a9ff60 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.010739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.037664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a8c79-23ea-41af-b458-f51ec90c1993 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.040511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.041411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.041925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.042409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.053399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:36.059307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:36.060183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:36.060970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:36.063545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 203/405] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:36.064640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.078720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.079594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.079882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.080695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/groups/269be88411f340db95cec0d172975d13/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.083563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, group_id=269be88411f340db95cec0d172975d13, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.085289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.104394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 203/406] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 01:40:35 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/groups/269be88411f340db95cec0d172975d13/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:36.105218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.225025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542b7cd-c676-4b95-880f-5dfb0dc304f5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.225227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bbffc-1a43-4da6-acfc-62bcbfe3c5c9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.270128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.270322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.270923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.271162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.271433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.272633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:36.272996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.277480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f8cd4-1b8c-4efb-9002-186fbf2eeadb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.285131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.286468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.286958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.287432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.287963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 204/407] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:36.289257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1ed3-09fa-4240-b06a-d339f5d2e227 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.289542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1ed3-09fa-4240-b06a-d339f5d2e227 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.289816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e1ed3-09fa-4240-b06a-d339f5d2e227 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.291404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 205/408] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:36.293209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1ed3-09fa-4240-b06a-d339f5d2e227 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.298557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.308116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3b42bc72-0cad-469e-842c-1c3d94bb2143 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:36.317238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:36.318263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:36.319078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:36.322392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 204/409] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:36.323936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.324442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.325669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.351303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:36.352924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:36.423058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e1ed3-09fa-4240-b06a-d339f5d2e227 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.449565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 205/410] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:36.450784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.461258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.462053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.462345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.462617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] PATH_INFO: `/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.463835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] RBAC: Authorizing `identity:get_group(group_id=69e552c6e1fa47e5b136b99a84d0c6a0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.465385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.467399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 206/411] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:36.473009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.612283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aaf6f9-4752-4684-8dd3-45b8abcf6d60 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.623597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.641442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.655114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.655964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.656242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.656515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.657976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:36.658409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.659853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.670385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 206/412] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:36.676954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.695972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cd016-9991-47fe-ba9e-a5a5fdaf9220 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.758329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.759729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.760012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.760293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] PATH_INFO: `/v3/projects/36f275dc1246410f9a8f5e0be2414a85` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.762191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] RBAC: Authorizing `identity:get_project(project_id=36f275dc1246410f9a8f5e0be2414a85)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.763615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.771867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 207/413] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/projects/36f275dc1246410f9a8f5e0be2414a85 => generated 344 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:36.780339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.817239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc540c7-453b-4cbe-8754-3c9dcaced366 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.867131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.867696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.867962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.868378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.869627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.872289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.878390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 207/414] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:36.879754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:36.917552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d08fde8-34a4-4e36-8982-3d1b162aed1e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:36.951695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.970832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:36.972640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:36.973071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:36.973518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] PATH_INFO: `/v3/projects/36f275dc1246410f9a8f5e0be2414a85/groups/69e552c6e1fa47e5b136b99a84d0c6a0/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:36.975637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] RBAC: Authorizing `identity:create_grant(project_id=36f275dc1246410f9a8f5e0be2414a85, group_id=69e552c6e1fa47e5b136b99a84d0c6a0, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:36.977228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:36.991401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:36.999191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 208/415] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 01:40:36 2022] PUT /identity/v3/projects/36f275dc1246410f9a8f5e0be2414a85/groups/69e552c6e1fa47e5b136b99a84d0c6a0/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:40:37.000330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:37.024974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9972c-499a-4f70-84b6-40e40afca36a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.122797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398fc4a-0468-41e5-9d1e-ca1454a40714 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.123354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:37.124012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.124299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.124576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.150912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:37.156634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:37.157801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:37.159449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:37.166433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 208/416] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:37.169724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:37.170679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.171102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.171516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.173171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:37.173595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:37.175480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:37.177519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 209/417] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:36 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:37.183894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:37.274293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:37.311533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a566f-75f0-4e16-a985-8644abe4d20f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.350405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af0e9d1-ef7e-431e-b57c-69bd15a1b2c6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.350597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:37.351123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.351410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.351708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91/groups/269be88411f340db95cec0d172975d13/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.354120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] RBAC: Authorizing `identity:create_grant(project_id=7134c0dad1564973aeb9696c872b6a91, group_id=269be88411f340db95cec0d172975d13, role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:37.355615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:37.365496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:37.374998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 210/418] 10.222.0.33 () {58 vars in 1442 bytes} [Fri Sep 16 01:40:37 2022] PUT /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91/groups/269be88411f340db95cec0d172975d13/roles/1ef4118652b24050b863bd53ae59decc => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:40:37.396244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:37.396884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.397163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.397437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.398154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] RBAC: Adding query filter params (name=member) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:37.398459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:37.399902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:37.417942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 209/419] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:37.424716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:37.548350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab76a-d135-4683-8715-c20adce88a09 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.577322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:37.590374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:37.591074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.591358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.591637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.673412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:37.675380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf91f4-6e1f-4c7d-812b-1c63a5ec59f5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:37.777687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 211/420] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:37.783862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:37.905033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a4f7-6971-403c-b5fb-40e7cbad262c None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.905686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a4f7-6971-403c-b5fb-40e7cbad262c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.906200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b9a4f7-6971-403c-b5fb-40e7cbad262c None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.907950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 212/421] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:37.913759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:37.914299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:37.914794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:37.934336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:37.935307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:37.946159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5133f62-f581-45f5-bd8f-0aabca5ec670 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:37.978226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:38.026728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:38.027376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:38.027658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:38.027931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:38.030612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:38.032137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 213/422] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:38.032258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:38.039347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 210/423] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:37 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:38.044774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:38.184804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86207057-ff75-4916-9a2e-8f9aed4326dc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:38.230972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:38.232054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:38.232548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:38.233019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:38.234376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:38.236051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:38.246509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 214/424] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:38 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:38.247491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:38.331265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:38.378293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:38.408804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:38.420704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1bdf8-0bad-4f0f-a82d-71bce2548b1c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:38.473684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:38.474710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:38.475168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:38.475638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:38.476607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:38.477093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:38.478943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:38.486346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 211/425] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:38 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1620c8d7a29041378a32461a8cde3643 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:38.522857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c3e40-e4cb-47c3-ae3a-d5a8f88717d6 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:38.595305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:38.596715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:38.597109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:38.597493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:38.624089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:38.632335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:38.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:38.634187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:38.634820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 215/426] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:38.641732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:38.803908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014f5c5-0574-4c25-97d3-574084a32263 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:38.811950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:38.851041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:38.851863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:38.852248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:38.852622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:38.853548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:38.854006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:38.855991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e2c6d-e947-4518-a1dd-b577949d1621 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:38.867410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 212/427] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:38.873810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:38.980298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:39.002867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b58fc34-1580-4bd2-a6cb-3ab976132507 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.036638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7ad32-b362-4b2b-a86f-404e25352281 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.037035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7ad32-b362-4b2b-a86f-404e25352281 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.037423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7ad32-b362-4b2b-a86f-404e25352281 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.039781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 213/428] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:39.044636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.044926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.045207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.061042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:39.062022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.062534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.063046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.073384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:39.074631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:39.141550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:39.143921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:39.190940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 214/429] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:39.230950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:39.247849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 216/430] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:39.253126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:39.362460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:39.366507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679c6573-9cbb-43bc-ac6e-e7561ea162f2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.415024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:39.415666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.415948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.416281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] PATH_INFO: `/v3/projects/71fcc35e243f47f0b56323cf9a428bc0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.417410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] RBAC: Authorizing `identity:get_project(project_id=71fcc35e243f47f0b56323cf9a428bc0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:39.418935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:39.420846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 215/431] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:39 2022] GET /identity/v3/projects/71fcc35e243f47f0b56323cf9a428bc0 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:39.426213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:39.557595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bb5fc-2aa4-490f-9103-d57b87ab1f79 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.612286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:39.613219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.613553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.613971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.615490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:39.617644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:39.620067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 217/432] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:39 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:39.626229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:39.631063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:39.715971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:39.774954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe6225a-e130-46c3-8f8e-878893a922c2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.789616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b526f7b-c7b6-47ec-b33c-b6fbc4aa2202 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.816262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:39.816845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.817128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.817397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.828340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:39.829287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:39.830782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.830782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.831055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.831712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=71fcc35e243f47f0b56323cf9a428bc0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:39.832019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:39.833467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496cd161-d2d3-4bec-a6e2-caf2599ebae5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f352a822-23a8-46dd-914b-06d7623f8c92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:39.834723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:39.835891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 16 01:40:39.836716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:39.837364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 218/433] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:39.838390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b34c-a7e9-4c89-b87b-e14493d79929 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.838720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b34c-a7e9-4c89-b87b-e14493d79929 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.838994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61b34c-a7e9-4c89-b87b-e14493d79929 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.840364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 219/434] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:39.844974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61b34c-a7e9-4c89-b87b-e14493d79929 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:39.852787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 216/435] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:39 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=71fcc35e243f47f0b56323cf9a428bc0&role.id=1ef4118652b24050b863bd53ae59decc => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:39.852787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736132a-325c-4be6-9048-5888814fee14 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:39.852787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736132a-325c-4be6-9048-5888814fee14 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:39.852787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9736132a-325c-4be6-9048-5888814fee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:39.874368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9736132a-325c-4be6-9048-5888814fee14 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:39.876057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9736132a-325c-4be6-9048-5888814fee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:39.907627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:39.968783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61b34c-a7e9-4c89-b87b-e14493d79929 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:39.974401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 217/436] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:40.009487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.020026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.020652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.020940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.021221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.021947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] RBAC: Adding query filter params (name=member) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:40.022262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.023675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead7c8d-e4b7-4c87-83ee-10ee16440a6e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.038797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 220/437] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:40:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:40.040391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736132a-325c-4be6-9048-5888814fee14 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.160182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9736132a-325c-4be6-9048-5888814fee14 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.199165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.199779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.200063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.200341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.222807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945705b-9f63-4d31-80d1-fcb4a221bc86 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.223104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945705b-9f63-4d31-80d1-fcb4a221bc86 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.223370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945705b-9f63-4d31-80d1-fcb4a221bc86 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.224822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 221/438] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:40.229914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.230213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.230488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.230623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.251177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:40.253565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:40.288164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.290008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.338849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 222/439] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:40.340195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.409698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 218/440] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:40.415301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.450586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9004ef-2169-406c-ad91-d641ff818dde None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.458271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.484677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.487218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.488143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.488492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.488704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.499522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:40.504974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:40.505917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:40.506726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 223/441] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:40.511981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.532549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c529-b544-458e-87a1-92736b513d28 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.567962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.568598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.568879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.569151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.570312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.571847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.573530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 219/442] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:40.578898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.619633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e675a2-fbee-4858-b9dd-501bf874457c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.655290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.656197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.656488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.656766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.657887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:40.658357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.660055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.669834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 224/443] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:40.669989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.682690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad490e-6481-4e51-8302-38edb2425c94 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.697915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.710424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.721349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.722356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.722801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.723104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.724276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.725702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.727300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 220/444] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:40.728055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.774704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ee97c-f4d5-4ff6-a563-e74666637246 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.808531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.809154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.809434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.809708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.819834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:40.825009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:40.825949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:40.826789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 225/445] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:40.827502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf12218-e9a9-43a8-8b2c-3b0396977c5d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.827574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:40.864676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.865297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.865576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.865852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.914321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.926503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb4b757-3066-446d-a996-53a01b6d1afe None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:40.927707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:40.935270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.936783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.962060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:40.962660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:40.962937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:40.963206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:40.963924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1620c8d7a29041378a32461a8cde3643, scope.project.id=7134c0dad1564973aeb9696c872b6a91) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:40.964230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:40.965667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:40.971838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 226/446] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1620c8d7a29041378a32461a8cde3643 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:40.972598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.060636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 221/447] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:41.067172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.093147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188f31b0-e4d0-4941-8371-ad534a155326 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.134636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.135264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.135596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.135879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.136561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:41.136872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.138297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.147478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 227/448] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:41.153208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.171408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.178989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.185279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6a36d-31ee-47d0-b050-980ae51ab437 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.225200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.225897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.226258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.226526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] PATH_INFO: `/v3/projects/36f275dc1246410f9a8f5e0be2414a85` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.228068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] RBAC: Authorizing `identity:get_project(project_id=36f275dc1246410f9a8f5e0be2414a85)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.229634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.231613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 222/449] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/projects/36f275dc1246410f9a8f5e0be2414a85 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:41.237049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.276464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c226fe4-81c2-46dc-a5aa-629d68c727cc None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.322265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.323193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.323612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.324026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.358082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcb11-5eaa-44d4-a378-095bd482d441 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.393742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.394414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.394733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.395018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] PATH_INFO: `/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.396152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] RBAC: Authorizing `identity:get_group(group_id=69e552c6e1fa47e5b136b99a84d0c6a0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.397598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.399219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 223/450] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/groups/69e552c6e1fa47e5b136b99a84d0c6a0 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:41.405743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.407237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.407366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.424290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.438973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.508355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 228/451] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 16 01:40:41.508896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff7203-3af2-4c07-a26e-87c9cb9a5cb6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.514162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.544130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.544738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.545022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.545299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.546066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] RBAC: Adding query filter params (group.id=69e552c6e1fa47e5b136b99a84d0c6a0, role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=36f275dc1246410f9a8f5e0be2414a85) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:41.546379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.547810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.554093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 224/452] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/role_assignments?group.id=69e552c6e1fa47e5b136b99a84d0c6a0&scope.project.id=36f275dc1246410f9a8f5e0be2414a85&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:41.613777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbaab8-7f6b-41bb-9ea5-d30f896bc55d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.629032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.650245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.650891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.651169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.651441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] PATH_INFO: `/v3/projects/7134c0dad1564973aeb9696c872b6a91` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.652590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] RBAC: Authorizing `identity:get_project(project_id=7134c0dad1564973aeb9696c872b6a91)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.654071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.655703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 229/453] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/projects/7134c0dad1564973aeb9696c872b6a91 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:41.661812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.776562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:41.783899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97fa-ea7a-475e-b4d1-3bb2894d756c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.817245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.817905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.818194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.818471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] PATH_INFO: `/v3/groups/269be88411f340db95cec0d172975d13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.819574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] RBAC: Authorizing `identity:get_group(group_id=269be88411f340db95cec0d172975d13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.821000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb81fb8a-86f5-4f85-9d02-fcf3ab06133c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.822608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 225/454] 10.222.0.33 () {56 vars in 1180 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/groups/269be88411f340db95cec0d172975d13 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:41.828442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:41.925975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28feac39-84e6-47fb-83eb-469e6bb6dbdf None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:41.959586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:41.960174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:41.960456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:41.960731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:41.961445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] RBAC: Adding query filter params (group.id=269be88411f340db95cec0d172975d13, role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=7134c0dad1564973aeb9696c872b6a91) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:41.961757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:41.963198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7f8a7-eab0-4cfb-9e45-a1f0bd442852 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:41.968727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 230/455] 10.222.0.33 () {56 vars in 1376 bytes} [Fri Sep 16 01:40:41 2022] GET /identity/v3/role_assignments?group.id=269be88411f340db95cec0d172975d13&scope.project.id=7134c0dad1564973aeb9696c872b6a91&role.id=1ef4118652b24050b863bd53ae59decc => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:44.685330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8748b-d548-48da-bf45-a7fd433fe87a None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:44.685827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8748b-d548-48da-bf45-a7fd433fe87a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:44.685827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8748b-d548-48da-bf45-a7fd433fe87a None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:44.687475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 226/456] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:44.692887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46a33-1f3b-4ea4-a041-36e9ded51512 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:44.693308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46a33-1f3b-4ea4-a041-36e9ded51512 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:44.693479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd46a33-1f3b-4ea4-a041-36e9ded51512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:44.718860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-efd46a33-1f3b-4ea4-a041-36e9ded51512 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:44.720077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-efd46a33-1f3b-4ea4-a041-36e9ded51512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:44.782115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:44.819544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 231/457] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:44.970195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96069-d2aa-47e5-85cd-badd6b07beea None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:44.970582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96069-d2aa-47e5-85cd-badd6b07beea None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:44.970754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96069-d2aa-47e5-85cd-badd6b07beea None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:44.972378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 227/458] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:44.977334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:44.977917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:44.978398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.007728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:45.009288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:45.015205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028025c-13d2-444d-a0b1-5aa04e07f240 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.015492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028025c-13d2-444d-a0b1-5aa04e07f240 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.015767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1028025c-13d2-444d-a0b1-5aa04e07f240 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.017093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 228/459] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:40:45.030446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.031036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.031527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.059070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:45.060272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:45.144638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 232/460] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:45.172495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 229/461] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:45.217676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.346771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe993ec-5bf1-483d-8eee-c8e2e7389164 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.354597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:45.393394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.394081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.394403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.394684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.404813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.406281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:45.415207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:45.425971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:45.427101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:45.428208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:45.428208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.428208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:45.433969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 233/462] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:45.439725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.539391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:45.547670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48dea5c-f4ba-46a1-9b6d-c2fbd80134f5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.592553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.593751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.594646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.595160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.611825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.613581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:45.613725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0169c109-1231-4c32-a11c-1b29dd7f4fec None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:45.636173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:45.637333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:45.638330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:45.638330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.638330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:45.639532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 230/463] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:45.641543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.654316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.655166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.655653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.656134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.656983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:45.657486 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.659156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:45.671733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 234/464] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:45.674777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.699774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:45.756278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521d302e-f11c-48eb-afbd-f8e6806b54a0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.790458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.791357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.791820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.792099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.794271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e0321-b290-4969-a704-fd24d1d2b3e3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.803222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.804661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:45.811450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:45.822471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:45.823396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:45.824242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:45.824242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:45.824242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:45.824242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 231/465] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:45.824898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.834342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.834955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.835285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.835558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.836266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:45.836569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.838218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13bcf4-535d-4b42-81a4-63af25956037 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 235/466] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e272e-39ce-4d1c-a6fa-394a00604d62 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e272e-39ce-4d1c-a6fa-394a00604d62 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e272e-39ce-4d1c-a6fa-394a00604d62 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 236/467] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:45.853663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e272e-39ce-4d1c-a6fa-394a00604d62 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:45.936896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bfd746-dedd-4f1e-a82e-9775f01b8c09 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.945650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:45.969552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e272e-39ce-4d1c-a6fa-394a00604d62 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:45.974183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be364db-8090-452b-a904-c58024ab67de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:45.974790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be364db-8090-452b-a904-c58024ab67de None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:45.975074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be364db-8090-452b-a904-c58024ab67de None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:45.975346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be364db-8090-452b-a904-c58024ab67de None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:45.975993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be364db-8090-452b-a904-c58024ab67de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:45.977428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be364db-8090-452b-a904-c58024ab67de None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.001152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 232/468] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:45 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:46.001152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be364db-8090-452b-a904-c58024ab67de None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.016653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:46.017418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.017708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.018031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.018872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:46.019108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:46.020805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6ce3-cc9b-4533-8e2b-42087d892eb2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.042172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 237/469] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:46.043583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.044170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.046174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.068839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:46.070758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:46.073092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:46.129299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be364db-8090-452b-a904-c58024ab67de None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:46.163251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 238/470] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:46.164147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.169312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:46.170204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.170709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.171218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.172085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:46.173807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100edf44-4db7-473d-bb58-2d12466ab851 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.206938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 233/471] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/users => generated 248 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:46.253240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:46.300859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aceff2c-f01b-4645-b481-7fce773b1b8d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:46.340580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:46.341243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.341529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.341800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.342524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:46.343967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e206b0-deb8-4666-9fc8-6c777acec973 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.373596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 239/472] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:46.406975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a39d-0aa7-46fc-9278-247142a9291b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.407301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a39d-0aa7-46fc-9278-247142a9291b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.407568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e7a39d-0aa7-46fc-9278-247142a9291b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.409400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 234/473] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:46.416246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.416543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.416869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.439564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:46.440813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:46.492348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a39d-0aa7-46fc-9278-247142a9291b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.526091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 240/474] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:46.619402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e7a39d-0aa7-46fc-9278-247142a9291b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:46.630954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:46.657065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:46.657704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.658117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.658392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.673421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:46.675440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:46.690539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:46.691495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:46.692353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:46.692353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:46.692353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:46.692353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 235/475] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:46.698953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.757509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:46.805290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d96b8-9d94-4734-8e1f-3644b97f9d91 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:46.842350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:46.842965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:46.843245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:46.843520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:46.844168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:46.844472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:46.846438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:46.855119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.858782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 241/476] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:46.867715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:46.992449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52136382-8a4d-4c0d-ac8d-38a2f5fd0ba1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:47.008047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:47.015055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9210f1-a7c5-462a-81c7-209f727cb7a7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:47.038787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:47.039407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:47.039691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:47.039963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:47.040612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:47.042183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:47.063832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:47.065043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:47.065415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:47.065753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:47.066536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:47.068035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:47.076827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 242/477] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:47.096646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.sql.core [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 01:40:47.096646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 01:40:47.096646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [parameters: {'id': '8604ff95f9d246319cf4f0ab1ac48b82', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 01:40:47.096646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81454) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 16 01:40:47.117900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return ref.to_dict() Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:40:47.119039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application yield resource Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise self.value Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application session.commit() Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 01:40:47.120269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.session.flush() Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application compat.raise_( Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 01:40:47.121168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:40:47.122155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application result.read() Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:40:47.122964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [parameters: {'id': '8604ff95f9d246319cf4f0ab1ac48b82', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:47.123896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 16 01:40:47.125105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:47.131269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 236/478] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 01:40:46 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:47.136988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:47.298263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f66b05-ae57-428d-aa29-d09cea15bfe5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:47.342412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:47.343049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:47.343328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:47.343598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:47.354163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b04ca109-3105-4933-8d29-0be02806e355 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:47.360048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:47.360932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:47.364295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 243/479] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:40:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:47.367547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:47.399260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:47.478196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cde3a4-d9b0-46c4-8cc1-d4a2cb49c591 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:47.512241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:47.512899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:47.513178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:47.513448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:47.514386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:47.514691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:47.516048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08447f9-9587-4519-9109-0f3491fcb08d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:47.524403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 237/480] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:49.055745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722499-d395-41cd-bc1e-98f128483402 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.056270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722499-d395-41cd-bc1e-98f128483402 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.056270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d722499-d395-41cd-bc1e-98f128483402 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.057917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 244/481] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:49.062856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec0ec-d63e-4e44-bf89-925ef467e5a5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.063268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec0ec-d63e-4e44-bf89-925ef467e5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.063433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ec0ec-d63e-4e44-bf89-925ef467e5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.086141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-833ec0ec-d63e-4e44-bf89-925ef467e5a5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:49.087366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-833ec0ec-d63e-4e44-bf89-925ef467e5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:49.087594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842676e-84cc-491f-a0ff-797869b02c59 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.087877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842676e-84cc-491f-a0ff-797869b02c59 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.088148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3842676e-84cc-491f-a0ff-797869b02c59 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.089698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 245/482] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:49.094646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43629-f84a-4c29-b5dd-dd50f23e5de7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.094927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43629-f84a-4c29-b5dd-dd50f23e5de7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.095203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43629-f84a-4c29-b5dd-dd50f23e5de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.117909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8fe43629-f84a-4c29-b5dd-dd50f23e5de7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:49.119611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8fe43629-f84a-4c29-b5dd-dd50f23e5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:49.178289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:49.223820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 238/483] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:49.259156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 246/484] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:40:49.305963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a8be0-1645-4012-b615-b118a50ffc87 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.306267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a8be0-1645-4012-b615-b118a50ffc87 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.306500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a8be0-1645-4012-b615-b118a50ffc87 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.307885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 239/485] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:49.319807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.320341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.320805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.339331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:49.340820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:49.426806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 247/486] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:49.562084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a8be0-1645-4012-b615-b118a50ffc87 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:49.586815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:49.633607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:49.722179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a8be0-1645-4012-b615-b118a50ffc87 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:49.778282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:49.779630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:49.780273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.780555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.780830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.788577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a505d5-17ca-4d7a-b4af-61df6c4c6a25 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:49.797041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:49.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:49.805362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.806198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:49.812849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 240/487] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:49.812849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:49.841602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:49.843109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.843890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.844766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.858399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:49.865101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:49.866020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.866816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:49.869580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 248/488] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:40:49.875344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:49.903743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:49.928332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e57c31-587f-4e75-ba48-58bb314c3c6e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:49.967873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:49.968504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:49.968784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:49.969057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:49.979909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:49.984626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:49.985548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:49.986399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 241/489] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:49.987090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.000542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357fd4a-24b2-4d79-ba56-3aa8edba252b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.039754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.040591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.041051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.041469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.042301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.042746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.044245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1c82f-06d1-48bf-9b5f-70973bcfcb73 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.052808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 249/490] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.053859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923751f-8d74-4fcb-b0f5-575bfc2f498a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.054189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923751f-8d74-4fcb-b0f5-575bfc2f498a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.054465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923751f-8d74-4fcb-b0f5-575bfc2f498a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.059816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 250/491] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:50.059816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923751f-8d74-4fcb-b0f5-575bfc2f498a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.072536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.103099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec22317-3473-4244-ba40-67d00e5ea5d0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.141661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.142376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.142742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.143032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.143733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.144043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.145418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.150711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.154665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 242/492] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.155738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.179468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923751f-8d74-4fcb-b0f5-575bfc2f498a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.219172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.219786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.220073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.220396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.221069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.221376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.222790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4e19aa-9784-4048-a2f4-64d1c8caaa28 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.231370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 251/493] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.233302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.233822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.234280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.255498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:50.256819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:50.277997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d4eb56-a817-410e-8ccd-19f24176814a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.313089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.313803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.314655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.314942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.326130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.327525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.334899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 252/494] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:50.335728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.338631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:50.359270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:50.360213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:50.361104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:50.361104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.361104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:50.361104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 243/495] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:50.361329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.417657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.445647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da232718-3352-45f9-9ddc-313ca5c02e63 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.472503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a6ac7-0cb3-4d4f-be21-57e81f08b2d3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.480703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.481352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.481631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.481924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.492974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.494849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.509482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.509482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.509721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-55ff5eae-0ed4-4f09-b2e7-608ab4785f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:50.509790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:50.510639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:50.511507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:50.511507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.511507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:50.511671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.511738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 253/496] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:50.512516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f7ba-e546-4612-b1f1-197ab86d59fd None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.512516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f7ba-e546-4612-b1f1-197ab86d59fd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.519749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b752f7ba-e546-4612-b1f1-197ab86d59fd None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.519749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 254/497] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:50.519749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f7ba-e546-4612-b1f1-197ab86d59fd None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.531845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.533826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-30abcb9e-8b79-4e22-b117-8901c07a1495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:50.548062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:50.549608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:50.550517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:50.550517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:50.550517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:50.550517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 244/498] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:50.551079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.551159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.551406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.569070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:50.570364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:50.585729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.632628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b752f7ba-e546-4612-b1f1-197ab86d59fd None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.639242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 245/499] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:50.640073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.674457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.679857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.680470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.680756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.681514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.682143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.682454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.684192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.701287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 255/500] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.701287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.746869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e99da3-9aa7-47a9-9e8e-cde96ec7c07a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.783983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.784592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.784874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.785145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.786101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.786101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.787494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.808687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4340145c-2c94-4f74-a3ee-7d01f185f3a1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.808849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 246/501] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.808849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.825721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.846987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.847531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.847809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.848081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.848722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:50.849028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:50.850422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:50.862615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 256/502] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:50.863415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:50.915152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:50.922506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ef4a5-77e4-4e78-aa53-1bf638490586 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.956029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:50.956655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:50.956985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:50.957259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:50.967033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ba737-c711-487f-8d17-c8bda8916299 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:50.967313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:50.972764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:50.973660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:50.974509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 247/503] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:50.975178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.005327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.005983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.006272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.006549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.015013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.016474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:51.029493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:51.030457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 257/504] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:51.031366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.064916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.079515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc908a3-e534-417b-b647-70aefac47b3d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.113676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.114289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.114531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.114801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.121759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.123323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.129058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f9cb9-87a6-4dc8-bb9b-865c586b7be3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:51.136516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:51.137400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 248/505] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:40:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:51.143988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.157368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.164613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.165269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.165551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.165835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] PATH_INFO: `/v3/users/glance` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.173257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.175258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:51.187408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:51.188501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:40:51.189515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:51.190859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 258/506] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:51.191642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.246017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71095fc8-c581-4b99-963d-be285b1f3145 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.284510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.285142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.285419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.285689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.291337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.296572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.297984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f0e55-f910-4363-b45e-7b418a81e3da None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.298089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:51.311859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:51.312778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:51.313678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:51.313678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:51.313678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:51.313678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 249/507] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:51.313678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.332131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.332739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.333025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.333304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.333993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:51.334303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.335655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.343432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 259/508] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:51.344215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.381415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.415673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568dfc3-a9e3-43dd-9e18-6c9306c83875 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.448552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.448809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45362d8-fc4f-4d98-b5dd-5af8c391f1de None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.449295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.449580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.449900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.450603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:51.450901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.452344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.483155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.483767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.484052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.484326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.485059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:51.485365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.486900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.488841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 250/509] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:51.489858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.524318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 260/510] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:51.525139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.545105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.589796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c31872-4ee2-4678-9bcb-dcaca4175ef5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.612802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.623695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.624301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.624583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.624858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.625576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:51.625673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74292e8b-a408-45f2-8358-7ee3d9b04d1c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.625905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.627847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.646337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 251/511] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:51.647051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.660001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.660601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.660886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.661164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.661797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:51.662150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.663522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.676999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 261/512] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:51.677741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.751294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0b5b1-b50c-485f-8c0a-fea4791a8c80 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.755164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.778378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9c765-366f-49b6-9a44-6f45921de97c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.785492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.786185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.786475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.786751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.796717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.798212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.811672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.812272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.812556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:51.812694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:51.813672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:51.814662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:51.814662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:51.814662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:51.814826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.814908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 252/513] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:51.814908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:51.847866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.881226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:51.882711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:51.913110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e53fa-1476-4a48-a8d6-dbce97744372 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:51.944914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:51.945518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:51.945789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:51.946090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:51.958377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:51.982416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 262/514] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:51.983280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.013083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.014856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.045808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.080613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fe9fa-abf5-43a0-a151-bab03be2f334 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.111258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 253/515] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:52.111883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.117071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.117679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.117994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.118268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.163685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.190652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.192120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.217580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484a338b-c617-4d24-80ba-8f1f3a349a51 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.250205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.250821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.251104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.251384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.252539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.254030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.262020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.280551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 254/516] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:40:52 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:40:52.281376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.308378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 263/517] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:52.309502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.397760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.406382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730c131-83a1-41c5-8399-f816af026000 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.425959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6fb48c-526d-4c8c-b10e-b600033df1b6 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.444815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.445451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.445730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.446035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.446683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:52.446985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.448360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.461810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 255/518] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:52.462650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.470311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.470951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.471235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.471630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.482585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.484039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:52.501688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:52.502717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:52.503741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:52.503741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.503741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:52.503741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 264/519] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:52.504210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.528845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.582927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a436d-4243-4c6d-8605-ba24823996af None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.610384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d4fe0c-4d6c-46de-927b-321d3383bc2e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.618970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.619600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.619875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.620148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.630541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.632403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.638517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.647320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.647953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.648231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:52.648329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:52.649185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:52.650099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:52.650099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.650099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:52.650292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.650361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 256/520] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:52.650361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.665289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.666880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:52.681702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:52.682846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:52.683908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:52.683908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:52.683908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:52.687438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 265/521] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:52.688137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.760634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34076e28-c22d-472c-a4ea-e3efb2623d44 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.762438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.792494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594005b-48cc-455f-826c-f824428fa4df None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.798701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.799746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.800049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.800331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.808700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.810175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:52.824375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:52.825452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:40:52.826759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:52.830044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 257/522] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:52.830873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.834550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.835261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.835638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.836008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.836759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:52.837159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.838641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.856146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 266/523] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:52.856146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:52.904965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:52.937990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfa408-ea62-4106-b431-4556554cd509 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.968965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8dbb4-f7dc-4f76-868f-95de60ff49df None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:52.974371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:52.975055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:52.975404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:52.975745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:52.976454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:52.976831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:52.978320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:52.995182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 258/524] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:52.995182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.010691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.011426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.011979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.012324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.013328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.013745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.015487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.019156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.033715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 267/525] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.033715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.105407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a5400-7310-47b2-abdb-5bd38b22f0af None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.137578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.141409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.141550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfca4df-bf04-4ba2-aa4b-d502bc1e9053 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.142123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.142408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.142680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.143427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.143715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.145343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.162929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 259/526] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 01:40:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.163566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.184544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.185266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.185609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.185977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.193607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.195087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:40:53.207962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:53.208933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.209941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:53.214119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 268/527] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:53.215066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.257452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.284515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888b199-461a-4bac-b759-b3e4cc9d1587 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.320220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.320848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.321125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.321632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.327839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.329263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.330229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dde212-1dcf-4a3e-a501-474b7b6c34aa None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:40:53.340906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:53.341963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 260/528] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:53.348068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.375033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.375754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.376093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.377041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.384678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.386326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:40:53.399203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:53.400071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 269/529] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:53.405954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.429207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.457818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968462e3-a6bf-4f78-b4ea-cba82a1feb24 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.490979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.491582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.491915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.492188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.503911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.519541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ad09a-1bb9-44ac-a40f-defb9b37f74a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.554332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.554939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.555233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.555491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.556186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.556490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.557924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.570570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.572021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.575238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 270/530] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.580181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.660150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.679805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a82f-735d-4c1a-94bb-49b9d1d30eaa None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.684870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 261/531] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:53.684870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.724864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.725712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.726202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.726633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.727460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.727919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.729533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.732285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:53.750374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 271/532] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.751446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.809408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24891972-94d9-4f0a-a640-eebddf93c645 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.847203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.847966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.848346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.848739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.849627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.850057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.851678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.872544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b29300-ed55-465d-8471-d1f892be35f2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:53.875650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 262/533] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.876958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.910769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:53.911610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:53.913123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:53.913708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:53.914828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=08454b4a2236492b9adacd16cfeec4e2) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:53.915146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:53.916590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:53.929898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 272/534] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/role_assignments?user.id=08454b4a2236492b9adacd16cfeec4e2&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:53.929898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:53.932357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:54.028397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:54.036197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609a1266-de40-40d7-b10a-7e6876c627c3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.072960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6ee54-f4ca-486a-96df-66d3d5476e25 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.078327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.078327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.078617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.078889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.091612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.093282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:54.111519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:54.112697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:54.113754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:54.113754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:54.113754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:54.120091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 263/535] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:54.121211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:54.137364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.138399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.139613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.140076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.141042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:54.143148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.146429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.159583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 273/536] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:53 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:54.162158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:54.346178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:54.383952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9fb23-d24c-496f-bbb1-ffdc0949064e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.398616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33f266-ce9f-4cdb-90d2-26912365b54b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.431010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.431570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.431846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.432854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.432962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=943c65ab7c814cc690876b3ba9293756) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:54.433205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.434817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.445891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 264/537] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:54 2022] GET /identity/v3/role_assignments?user.id=943c65ab7c814cc690876b3ba9293756&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:54.447905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.448816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.449325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.449795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.450667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:54.451188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.456744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a168919-04ec-4910-882f-a57bbe431a90 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.476865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 274/538] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:54.487075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:54.523298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:54.547478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf781-87d7-440c-ba8b-6fd3133f70ad None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.548121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf781-87d7-440c-ba8b-6fd3133f70ad None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.549318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bf781-87d7-440c-ba8b-6fd3133f70ad None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.555533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 275/539] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:54.563331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.563975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.564474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.599249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:54.600824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:54.630419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f1cff-f605-415b-a5cf-b2d281f9633f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.668093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.668734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.669011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.669283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.685735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 276/540] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:54.695381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.696891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:40:54.726863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:54.727778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:54.729094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 265/541] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:54.734127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:54.807984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:54.858316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5366b8-26ab-4b4a-bc39-6baf44347eeb None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:54.903955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:54.904568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:54.904852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:54.905126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:54.905827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:54.906162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:54.907611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:54.925233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 277/542] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:40:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:54.930793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.054361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:55.072789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.078102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d478c-18a1-4498-a3a8-c5bdf59bac19 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:55.113745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:55.114322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:55.114601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:55.114897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:55.115621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=ba3e762164ac406bbdd85ff1185c53c5) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:55.115934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:55.117370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:55.131899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 266/543] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:54 2022] GET /identity/v3/role_assignments?user.id=ba3e762164ac406bbdd85ff1185c53c5&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:55.248196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb75b59-82d5-46df-af7a-b271ddbf8a75 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:55.283816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:55.307179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:55.308233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:55.308717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:55.309202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:55.322076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:55.328635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:55.329676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:55.330684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:55.333624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 278/544] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:55.339154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.460201 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b7fcf-3da2-48f8-aa5c-91e6e0b84c87 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:55.497308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:55.497948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:55.498230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:55.498502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:55.499235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:55.499571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:55.500944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:55.509890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 267/545] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:55.515425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.640103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce2bf6-c23c-4a19-807a-0ab098416188 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:55.692075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:55.692703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:55.692982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:55.693256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:55.705802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:55.707267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:55.730621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:55.731535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:55.732991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:55.732991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:55.732991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:55.732991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 279/546] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:55.737556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.740510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:55.860151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c8281-30f2-4c3e-a075-6745b8bd4e0f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:55.894882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:55.895541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:55.895818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:55.896087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:55.896726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:55.897026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:55.898481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:55.911388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 268/547] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:55.919218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:55.957293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:56.031021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fb0cd-ec15-4604-8d72-32a67b0e4c36 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:56.066177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:56.066820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.067104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.067379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.075307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:56.076752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:56.088564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:56.090131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:56.091724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 280/548] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:40:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:56.099031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:56.184887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:56.227920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a06a8-3fd1-4b85-b107-0f259b057599 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:56.265902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:56.266538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.267498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.267779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.268523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:56.268834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:56.270331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb9320d-a9bb-4a61-8476-5262fa100ea1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:56.292055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 269/549] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:40:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:56.299603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:56.419658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:56.431150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7ce3e-3b15-477e-b4ea-8607130397b8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:56.476619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:56.477241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.477523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.477798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.569268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:56.570676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:56.684474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:56.695327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 281/550] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:40:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:40:56.700550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:56.701047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91502f-001c-4a02-a00e-593d156670d0 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.701482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91502f-001c-4a02-a00e-593d156670d0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.701660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91502f-001c-4a02-a00e-593d156670d0 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.703232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 270/551] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:56.715193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d8fb-05c7-419f-883c-9f53ff0d74d5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.715477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d8fb-05c7-419f-883c-9f53ff0d74d5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.715747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69d8fb-05c7-419f-883c-9f53ff0d74d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.750854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-df69d8fb-05c7-419f-883c-9f53ff0d74d5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:56.752679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-df69d8fb-05c7-419f-883c-9f53ff0d74d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:56.806356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f32e9ca-736e-4f6f-b0c2-af63bfb714ba None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:56.842496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:56.843067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.843351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.843627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.862372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:56.863937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:56.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:56.893737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:56.895088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:56.895088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:56.895088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:56.895088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 282/552] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:56.899794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:56.904578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 271/553] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:56.966261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:56.980492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015bf5-cb10-4c47-b597-492862258d47 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.980805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015bf5-cb10-4c47-b597-492862258d47 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.981054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015bf5-cb10-4c47-b597-492862258d47 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:56.982669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 272/554] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:56.988339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:56.988626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:56.988902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.030967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:57.032156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:57.032960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c94bc-bfc2-4881-b405-27e95c8fb4a1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.068520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.069133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.069422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.069701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.070375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:57.070685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:57.072048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:57.085271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 283/555] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:40:57.090646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.118082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.161338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 273/556] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 16 01:40:57.224032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965356a7-b5b5-4a69-9b3b-73bef9603b54 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.225775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.264613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.275709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.276365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.276645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.276985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.296510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:57.298007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:40:57.319891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:57.321216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:57.322405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 284/557] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:57.335311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.425753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baeacc2-f20c-4504-a946-19c374ae8477 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.470863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c67356-80fa-41c1-ac68-7a3152903245 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.471057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.471512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.471796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.472070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.485463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8f065908-d1b0-46af-a32c-1ce9091ea1c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:57.492454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:57.494161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:57.495108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:57.503342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 274/558] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:57.503491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae12f9-f1e3-48a5-ab38-3fed28d00f4f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.503673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae12f9-f1e3-48a5-ab38-3fed28d00f4f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.503954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae12f9-f1e3-48a5-ab38-3fed28d00f4f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.505359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 275/559] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:57.506941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae12f9-f1e3-48a5-ab38-3fed28d00f4f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.522063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.522679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.522961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.523236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.523935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:57.524246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:57.525661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:57.541906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 285/560] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:57.541906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.561964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.571692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.630432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae12f9-f1e3-48a5-ab38-3fed28d00f4f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.662092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f4688-a301-4ccc-b519-deba7b13457f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.667176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.667795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.668078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.668357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.669023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:57.669333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:57.670737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2481e4-be15-46db-9c77-7c88edd4e29e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:57.679235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 276/561] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:57.680320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.680608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.680887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.698687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:57.699886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:57.704806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.705642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.706155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.706604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.717717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:57.722976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:57.723902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:57.724775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:57.731629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 286/562] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:57.732791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.772913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 277/563] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:57.774346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.819973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.833601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:57.853969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f615e-14c0-49e0-b0e5-c000fbfa9dfb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.890350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.891244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.891665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:57.892647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:57.893525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=833561908cfb4105b9851563d4253138) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:57.893999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:57.895638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:57.910008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 287/564] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/role_assignments?user.id=833561908cfb4105b9851563d4253138&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:57.911225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:57.922228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789b155-e1ff-4f1a-bbaf-ef1436d6a08c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:57.996379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:57.998846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:57.999252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.000565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.014256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.015827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-37863c3b-71d5-4974-8ca6-4787d7e9f1bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:58.032034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.033809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:58.034928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:58.034928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.034928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:58.037611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab93f71-d8f5-40bb-89c6-5f2e2d7d8c59 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.041477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 278/565] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.042431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e4-136f-4a95-ac6a-4a69821b8f57 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.042825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e4-136f-4a95-ac6a-4a69821b8f57 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.043208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6836e4-136f-4a95-ac6a-4a69821b8f57 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.044964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 279/566] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:40:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:40:58.045800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6836e4-136f-4a95-ac6a-4a69821b8f57 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.077826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.078462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.078749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.079022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.079805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:58.080114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.081554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418cc36e-f608-4e1c-b04c-48d925bcae52 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.093246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 288/567] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:58.094517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.094811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.095704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.114102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:40:58.115310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:40:58.117571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.147235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.166634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6836e4-136f-4a95-ac6a-4a69821b8f57 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.202195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 289/568] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:40:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:40:58.202195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.214130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.214858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.215213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.215564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.216283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:58.216661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.218159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.235037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 280/569] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:58.235037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.332220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8104cdf5-afb0-4cbe-8b1a-fee6c8a40f31 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.370421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.371217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.371666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.371968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.380197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.384142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d66a828-57a6-4933-953e-544d027aa950 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.387101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:58.393176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.394144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:58.394990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:58.401936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 290/570] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.402995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.426465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.427170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.427907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.428206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.441910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.444378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.447098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:58.464377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.465400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:58.466323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:58.466323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.466323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:58.470081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 281/571] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.471267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.520892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c6e5-9cff-4fb7-9478-aa2fe7ea8cb8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.557409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.557992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.558278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.558555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.566756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.568200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:58.580165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.581152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 291/572] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.587379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.599753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99492d6e-4ae3-4afc-a940-e345b7e525b0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.639935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.640555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.640824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.641132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.641798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:58.642683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.644067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.656723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 282/573] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:58.656723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.663031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.710324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b48eaf2-6d93-48e3-bf50-ff4fe38e86d1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.714639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.748229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.748845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.749132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.749412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.750098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:58.750413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.752347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.759996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47dba3-f616-4c8d-8957-f83ad990b4e0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.769895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 292/574] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:58.769895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.799382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.800026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.800306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.800577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.811177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:40:58.816806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.817754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 283/575] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.818907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.884768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4712c-2f77-4d76-a2a1-7806eb65654b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.902822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.922430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.922974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c9a233-682a-47e1-bb08-e0fd87df552a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:58.923088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.923394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.923677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.924662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:58.924974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.927320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.945233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:58.954128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 293/576] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:58.954128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:58.967526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:58.968523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:58.968892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:58.969307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:58.981687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:58.983186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:58.997547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:58.998755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:58.999682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:58.999682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:58.999682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:58.999682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 284/577] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:58.999920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.068395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c78739d-ca68-4519-9d73-5d5efe9fb79d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.104980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.106175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.106683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f636-c155-4779-b573-0740d1da2bc8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.106870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.107480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.115242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.116687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:59.129885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:59.130853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:59.131825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 294/578] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:59.132946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.144375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.145482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.145886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.146580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.147381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:59.147789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.149257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.162018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 285/579] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:40:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:59.162018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.177090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.194851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.249375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae65a5-07fe-4e6b-baff-afc032dbab39 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.280069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0b9ec-f4ea-4799-a12c-62ce194b1aa4 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.302581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.303217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.303503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.303775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.315472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.316914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.317148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.317763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.318077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.318358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.319175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:59.319543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.320901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:59.331194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:59.332223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:59.334211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:59.334211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.334211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:59.334211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 295/580] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:59.334211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.339343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 286/581] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:59.339343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.432967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.436584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.442926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48dbf6-fde1-466b-8203-647f00d42629 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.451402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03996549-1804-4d3d-80f8-f935834ce3b9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.479590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.480227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.480510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.480786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.490970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.491637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.491882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.492237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.492682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.493092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.493710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:59.494130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.495920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:59.509457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:59.515490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:59.516626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:59.516626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.516626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:40:59.516626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 287/582] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:59.516626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.521034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 296/583] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:59.525581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.620300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21ff68b-78e8-4e2d-b6a8-b1ea8ce879fd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.630583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c86eb8c-dd66-4371-a51f-65ae05a962a2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.654604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732278-b920-47ea-9448-abf988cad04e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.655214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732278-b920-47ea-9448-abf988cad04e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.655490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732278-b920-47ea-9448-abf988cad04e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.655760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93732278-b920-47ea-9448-abf988cad04e None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.656393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732278-b920-47ea-9448-abf988cad04e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:59.656694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732278-b920-47ea-9448-abf988cad04e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.658710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93732278-b920-47ea-9448-abf988cad04e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.668272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.668901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.669184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.669460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.674761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 288/584] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:59.674761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732278-b920-47ea-9448-abf988cad04e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.677319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.681765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.683271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:40:59.695602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:59.696581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:59.697537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 297/585] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:59.699165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.706897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.785654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93732278-b920-47ea-9448-abf988cad04e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.799613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af2d07-ec55-4a33-951b-7fdabab392fa None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.820524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.821129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.821469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.821748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.822481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:40:59.822785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.824152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.835111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 289/586] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:40:59.835673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.835887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.836670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.836946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.837216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.851942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.853447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:40:59.868005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:40:59.868954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:40:59.869831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:40:59.869831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:40:59.869831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:40:59.869831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 298/587] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:40:59.869831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:40:59.906762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.941708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:40:59.949961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05ebbbd-9852-4258-9eab-392070cc0552 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.987695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:40:59.988337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:40:59.988617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:40:59.988891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:40:59.991532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c40334-3092-4c06-96c5-3d568470da06 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:40:59.995810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:40:59.997266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:00.008536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:00.009577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 290/588] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:00.010695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.032942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.033510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.033821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.034221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.034917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.035228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.036652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.054589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 299/589] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:40:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.055594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.116947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb85d63-b25d-4abb-bba8-aa994228bd37 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.139913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.151855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.152481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.152760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.153036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.155541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879889e-d9be-49de-b2fa-a1adb85c6d57 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.160826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.162254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.171351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:00.173718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:00.174812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 291/590] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:00.175756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.189970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.190581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.190869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.191145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.191815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.192123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.193474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efe5d9-6652-4434-b99a-fd4758ec7064 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.205029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 300/591] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.206202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822edc-0458-4e0f-8b72-9f5064d34671 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.206493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822edc-0458-4e0f-8b72-9f5064d34671 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.206773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23822edc-0458-4e0f-8b72-9f5064d34671 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.207972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 301/592] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:00.209943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822edc-0458-4e0f-8b72-9f5064d34671 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.283850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b110b10-9ba5-4f19-978c-f52773e74450 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.316614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23822edc-0458-4e0f-8b72-9f5064d34671 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.321298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.321934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.322213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.322481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.323158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.323483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.324891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.336475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 292/593] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.337254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.349648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.350314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.350597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.350873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.362085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.363518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:00.377286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:00.378445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:00.379627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:00.379627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:00.379627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:00.381998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 302/594] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:00.383167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.385711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.412418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.441744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbff2d5-4f20-47ce-9bee-28a67f229793 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.476002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.476691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.476977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.477251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.478009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.478316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.479741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a65398-11d0-46a9-8d47-6af2218fc7b5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.483728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c42284-2c15-48e7-b63d-196a06b03cdd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.496807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 293/595] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.498053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.498347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.498628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.518235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:00.519449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:00.523218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.523854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.524141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.524421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.531087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.532555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:00.543622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:00.544566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:00.545490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 303/596] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:00.546011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.588986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 294/597] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:00.590211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.623316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.646553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.660301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094c01e-a5d2-44cd-8995-f677fa2bb7ce None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.695482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.696387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.696866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.697157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/08454b4a2236492b9adacd16cfeec4e2/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.706334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd382ed7-7726-4319-b940-c74b85cdf5bb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.711928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=08454b4a2236492b9adacd16cfeec4e2, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.713380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.733903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 304/598] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:00 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/08454b4a2236492b9adacd16cfeec4e2/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:00.733903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.752694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.753468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.753827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.754129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.754793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.755146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.756808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.771844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 295/599] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.772730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.860068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce35efeb-62cc-4027-98bd-c882c90660d8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.890584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.899304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.899956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.900244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.900521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.902071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046003af-5c4e-4e64-8d75-98e3ca291dfc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:00.908023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:00.913288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.915082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:00.931826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:00.933729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:00.934833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:00.934833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:00.934833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:00.934833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 305/600] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:00.934833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:00.948310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:00.948855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:00.949553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:00.949553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:00.950145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:00.950458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:00.951911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:00.965616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 296/601] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:00.966509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.048920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0b936-69c7-4343-9ed4-66a49ac54642 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.070127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e6214-3230-47b8-b961-1526281ee5de None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.084919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.085812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.086115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.086391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.093196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.094750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.106328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:01.106895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:01.107937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:01.109133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:01.109692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.109901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.110269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.112600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 306/602] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:01.113367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.122558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:01.128070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:01.129227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 297/603] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:01.130845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.146698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.175363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.232342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fc9814-7aa7-428e-a914-6f1f556c79ca None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.242121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16da4a1-acde-4b96-a819-454ff1ca789e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.275718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.276335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.276625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.276905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.277558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:01.277887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.279264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.284766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.285527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.285937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.286342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.296080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 307/604] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:01.296080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.305277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=6e5607c5bb0f43cc9e79e6e0351077a0, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.306825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.320655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 298/605] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:01 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:01.321324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.414889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.427455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3498e1-9773-4282-9749-a765e5ca67bb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.440903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.472219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.472848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.473128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.473399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.474139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:01.474446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.475961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.481343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7559ac-9dbf-497b-9744-39a82d9fbede None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.490025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 308/606] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:01.490898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.527931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.529050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.529492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.530289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.531392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:01.531846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.533637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.544812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 299/607] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:01.546449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.614999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e524c-afd5-42aa-a49a-da9777e1ff44 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.664159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.665392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.665846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.666590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.670417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f054c4-5624-4714-aa13-5d6bea937c87 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.678185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.679954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:01.698355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:01.699474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:01.700672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:01.701885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.709584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 309/608] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:01.709584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.725809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.727086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.727854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.728333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/943c65ab7c814cc690876b3ba9293756/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.741963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:01.751564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=943c65ab7c814cc690876b3ba9293756, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.753916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.771815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 300/609] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:01 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/943c65ab7c814cc690876b3ba9293756/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:01.773201 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.835274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe28f56-83a3-460a-a2de-4990b7f33713 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.880899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.881900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.882348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.882769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.897675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.899545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.901741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6623352-7d84-4186-ab2f-6371dd1cad55 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:01.919585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:01.920714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:01.921626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:01.921626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:01.921626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:01.924329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 310/610] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:01.931643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:01.964305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:01.965327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:01.966431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:01.966932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:01.967991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:01.968576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:01.971210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:01.986627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 301/611] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:01.993487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:02.061394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:02.104162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:02.144247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c982ad-dce2-4e5c-a859-e5cf17405de7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:02.147192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7769461-92dc-4926-b169-e0103aa3d50b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:02.186986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:02.187602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:02.187889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:02.188164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:02.188876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:02.189182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:02.190786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:02.191767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:02.192826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:02.193807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:02.194272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/ba3e762164ac406bbdd85ff1185c53c5/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:02.203894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 311/612] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:02.210001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:02.212107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=ba3e762164ac406bbdd85ff1185c53c5, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:02.214826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:02.233670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 302/613] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:01 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/ba3e762164ac406bbdd85ff1185c53c5/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:02.347417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd804e-9155-41f2-a848-a85125696dfb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:02.394569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:02.395668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:02.396144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:02.396814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:02.410628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:02.412341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:02.428756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:02.430469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:02.431665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:02.433860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 312/614] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:02.439959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:02.543594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:02.567287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4493163d-46c6-438e-bb3c-70b3a1e1118c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:02.616162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:02.617047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:02.617495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:02.617951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:02.618841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:02.619327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:02.621073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:02.640759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 303/615] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:41:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:02.646715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:02.660576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:02.763294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d18c4-6df3-4fda-870b-f97520d909e3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:02.809187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:02.809748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:02.810058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:02.810337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:02.830767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:02.832227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:02.850968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:02.851972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:02.852881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:02.852881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:02.852881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:02.852881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 313/616] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:02.858018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:02.987685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39136f-7f66-40b8-9164-12c5dee84b20 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:03.034000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:03.034621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.034900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.035176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.035826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:03.036130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:03.037508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:03.053778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 304/617] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:03.059755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:03.123030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:03.190109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b940b76-b125-41e9-a369-8786948534f9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:03.230726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:03.231363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.231646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.231922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.239279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:03.240857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1f4cbd94-911b-4332-be06-d4e7f84060be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:03.252706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:03.253783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:03.254734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 314/618] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:03.262503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:03.266145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:03.277453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0576-a36a-40bc-8e3c-cb524474ee0a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.277935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0576-a36a-40bc-8e3c-cb524474ee0a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.278352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf0576-a36a-40bc-8e3c-cb524474ee0a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.284294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 315/619] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:03.286599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2680-df35-4943-848f-a39fbcac596d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.287210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2680-df35-4943-848f-a39fbcac596d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.289087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736f2680-df35-4943-848f-a39fbcac596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.320873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-736f2680-df35-4943-848f-a39fbcac596d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:03.323016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-736f2680-df35-4943-848f-a39fbcac596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:03.431565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc51b96-527e-4e2d-8d02-81adb4b3b1cd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:03.431879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 316/620] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:03.485347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:03.486548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.486833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.487112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.487809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:03.488121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:03.489562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:03.507413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 305/621] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:03.513515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f2680-df35-4943-848f-a39fbcac596d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:03.582852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:03.649980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736f2680-df35-4943-848f-a39fbcac596d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:03.686894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:03.687999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.688538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.689660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/833561908cfb4105b9851563d4253138/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.707447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=833561908cfb4105b9851563d4253138, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:03.709297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3f0f0-a801-4f6c-9d31-fab95c8d8c5f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:03.725953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 317/622] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:03 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/833561908cfb4105b9851563d4253138/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:03.804072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:03.850570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58e84-b11f-466a-9cfa-94d75bf7ff58 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.850765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58e84-b11f-466a-9cfa-94d75bf7ff58 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.851044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f58e84-b11f-466a-9cfa-94d75bf7ff58 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.852660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 318/623] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:03.858204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:03.858503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:03.858760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:03.894005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:03.895228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:03.912526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:03.990231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd43b4-a2c4-4b3b-8939-6c3be30d5085 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.008068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 319/624] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:41:04.030476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.031189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.031480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.031761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.043119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:04.048441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:04.049375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:04.050629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 306/625] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:04.055739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.090337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:04.162670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a6048a-4265-4ce4-b6de-a6e866f598c5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.198245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.198856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.199132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.199408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.200070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:04.200375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.201734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.210271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 320/626] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:04.215989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.322010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b496c8d-99ef-425f-a9ff-bbd2204b7b0d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.346247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:04.358497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.359138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.359418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.359692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.370451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.371902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:04.387882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:04.388872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:04.391102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:04.391102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:04.391102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:04.391102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 307/627] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:04.397267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.421729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.508253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbd8421-4670-4283-bde7-1ebe43f4965a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.518202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:04.544789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.545418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.545700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.546013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.546665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:04.546971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.549158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.564362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 321/628] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:04.570248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.670577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d00e1-fefe-4980-beaa-dac2e1f1c31c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.678762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d753e-202d-46c0-840e-25b1595b1892 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.716256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.716892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.717174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.717449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.717945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.718796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.719387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.720018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.724842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.726313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.731634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:04.737753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:04.738845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:04.739724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-02a6f7cd-f5ac-4ab2-bc65-3f02959c948a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:04.740374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:04.741230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 322/629] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:04.742235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4674e7-da55-481c-8032-4a19f367500f None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.745448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 308/630] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:04.746452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4674e7-da55-481c-8032-4a19f367500f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.746769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4674e7-da55-481c-8032-4a19f367500f None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.747759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.752361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 323/631] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:04.752361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4674e7-da55-481c-8032-4a19f367500f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.760497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:04.792459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:04.866008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a316f60-7b2a-4342-9d50-c14a3d382fc5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.873712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4674e7-da55-481c-8032-4a19f367500f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:04.903961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.904976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.905578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.906181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.907124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:04.908179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.910085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.915541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:04.916161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.916442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.916719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.917387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:04.917692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:04.919131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efca5a-7e0f-468b-8fed-2e648079d39c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:04.929532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 324/632] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:04.930947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:04.931166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:04.931405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:04.933939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 309/633] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:04.935164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:04.962168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:04.963871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:05.048802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.051155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.065125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 325/634] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:05.065125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.068825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9b3727-8b31-453b-8b80-2644ef6d97f1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.109902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.111390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.111867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.112283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.123572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.125361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c6904ff6-a0d9-48d2-bf67-153ace0e520b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:05.142102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:05.143281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:05.144337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:05.144337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:05.144337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:05.150659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 310/635] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:05.152167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2630-2448-4342-86e7-c4237b2faeec None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.152741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2630-2448-4342-86e7-c4237b2faeec None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.153162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba2630-2448-4342-86e7-c4237b2faeec None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.154841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 311/636] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:05.155769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2630-2448-4342-86e7-c4237b2faeec None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.168753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef751d4c-d579-4276-abb6-ce420c9d746a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.206641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.207175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.207457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.207731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.281371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba2630-2448-4342-86e7-c4237b2faeec None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.281839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.291855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.293681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.333734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.334384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.334672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.334946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.335585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:05.335895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.337333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462c3b-9376-4d62-b113-c0f4c2f10f17 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.355583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 312/637] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:05.356821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.357109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.357386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.366470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.381302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:05.382567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:05.420444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 326/638] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:05.420444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.481417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 313/639] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:05.481417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.529556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.535893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53bdae-569c-4a9b-ab28-32622c1aab06 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.581695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd478f8-80eb-4621-bbe3-13ac010e9f81 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.582506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.583138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.583420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.583692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.603810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:05.610471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:05.611488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:05.612339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:05.619223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 327/640] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:05.619223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.629589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.630293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.630581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.630857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.632941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.640554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.642789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:05.655093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:05.656256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:05.657970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:05.664006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 314/641] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:05.664006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.765119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0db66-01ec-4658-b571-0fb566072ffb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.771183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5116b98f-7fdc-4159-a0b6-a86f404f70fb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.800484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.801116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.801399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.801668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.806440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.807050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.807331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.807607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.808622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:05.808622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.809960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.812317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.814344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.823623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 315/642] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:05.823623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:05.833116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:05.834185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:05.835142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:05.835142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:05.835142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:05.835142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 328/643] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:05.835398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:05.852292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.887112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:05.941746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad17543-f170-49b0-94d9-e91713dc99af None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.948745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff7a63-1d0b-43fa-8294-9660bb6edc42 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:05.977124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.977731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.978045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.978340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.979060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:05.979369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:05.980800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:05.985158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:05.986360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:05.986641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:05.986916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:05.997088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:05.999260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 316/644] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:06.000238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:06.003165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:06.004127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:06.005235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:06.009078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 329/645] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:06.009924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.082742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.114226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854801d1-2adb-4e45-adca-fffcbb52d685 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.118750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24134-f5f8-49cc-b6bb-17a1fe19b70a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.128838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.152164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.152807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.153090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.153360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.153956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.154559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.154844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.155123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.155759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:06.156064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.157575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.164625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.166158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.170867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 330/646] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:06.176042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:06.183403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:06.184429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:06.185371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:06.185371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.185371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:06.185371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 317/647] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:06.186114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.289363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea0614-5b47-4eca-b267-84fe010cc42d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.300299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78abf2e-8b40-4d70-bb11-a62abea79b28 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.319882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.326375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.327163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.327437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.327706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.334249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.334787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.335067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.335338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.335994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:06.336295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.337662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.345634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 318/648] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:06.346266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.373150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.398849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.400310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb2822-7f5b-47ed-a9a5-61d9b3920a34 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.444549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6eba81-b9cd-4129-ba8e-3cc09fb1f77f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.478224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.478846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.479129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.479398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.485975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.487515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:06.499255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:06.500312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 319/649] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:06.502018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.502765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 331/650] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:06.504169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746b13-15c3-455e-acb7-4eadbfe15792 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.504594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746b13-15c3-455e-acb7-4eadbfe15792 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.505344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24746b13-15c3-455e-acb7-4eadbfe15792 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.507598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 332/651] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:06.508292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746b13-15c3-455e-acb7-4eadbfe15792 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.538820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.587984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.600822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77362ee-fc81-4f25-88a9-94cba4e4acb0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.611204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24746b13-15c3-455e-acb7-4eadbfe15792 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.634820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.635420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.635695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.635969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.636598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:06.636904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.638307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.644747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.645369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.645655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.645957 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.650157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 320/652] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:06.650939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.659087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.659943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:06.675096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:06.676055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:06.676959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:06.676959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.676959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:06.676959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 333/653] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:06.676959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.756047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703fe001-3a81-4c05-a843-0fe771b3fcb9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.765469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.783114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e744589-0c92-4729-a8ce-9e1b4ed41799 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.790956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.791591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.791868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.792136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.802446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.803908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.812073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:06.816627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.817231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.817514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.817789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.818513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:06.818824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d2084ab5-f4b6-4bdc-9fed-48b99ea899f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:06.819146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:06.820146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:06.821045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:06.821045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:06.821045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:06.821227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:06.821299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 321/654] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:06.821850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.822161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.822432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:06.835618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 334/655] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:06.836698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.839729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:06.840910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:06.906401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 322/656] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:06.907265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:06.958747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4687ff28-784a-4503-ae4c-5679d6f16062 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:06.997761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:06.998419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:06.998954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:06.999228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.007172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.008628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.010075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b28641-dbe8-4b53-8fc6-ce6966ef4027 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:07.023395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:07.024380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:07.025328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 335/657] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:07.026876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.028816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.050817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.057786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.058429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.058713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.058993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.059635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.060003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.061373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.077251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 323/658] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.077251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.138073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db8e57-5ddf-4b5b-b719-cae314a65f4b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.171934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e8236-54db-4e7c-8fea-c650d9b6013d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.174298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.174903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.175181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.175451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.176076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.176378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.177791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.190662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 336/659] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.191446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.207432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.208040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.208320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.208597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.209315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=08454b4a2236492b9adacd16cfeec4e2) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.209622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.211094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.216683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 324/660] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/role_assignments?user.id=08454b4a2236492b9adacd16cfeec4e2&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.217442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.257580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.284862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.308031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8339e-fc81-4eff-b982-e504d396bc09 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.337185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeedb9-310a-4d40-a49c-a3f1244fd6bd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.345285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.345945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.346228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.346502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.347247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.347555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.349021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.369531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 337/661] 10.222.0.33 () {56 vars in 1137 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.370817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.380032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.380682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.380961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.381235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.389579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.390987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:07.403830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:07.404797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 325/662] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:07.405769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.497369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab0e55-7e2e-49d6-bef5-33614a26a5bd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.515705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cc88e-0789-4e9d-8ca8-59de4833329b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.519933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.531159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.535966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.536604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.536886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.537158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.547348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:07.552702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:07.553736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:07.554632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 338/663] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:07.555362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.558854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.559656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.560052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.560394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.567738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.569187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:07.581182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:07.582147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 326/664] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:07.583664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.667984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aead467-dd95-4844-8681-b30cc476ca7f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.686452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b513b7-7eef-46bd-a99c-ef8275aec7b8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.710294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.710976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.711256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.711527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.721909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.722522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.722807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.723082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.723808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.724119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.725558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.744657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 327/665] 10.222.0.33 () {56 vars in 1139 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.746027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.765428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.785058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:07.788073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.789668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.864262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48819ce7-032c-4fcd-9e84-2fa9a00c2996 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:07.897663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:07.898301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:07.898579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:07.898863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:07.899524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:07.899835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:07.901202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:07.903667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 339/666] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:07.904755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.912166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 328/667] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:07.912985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:07.998260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.014888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.020792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be11bc3-5f55-44ac-904a-ee2c79e92c4d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.022841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dae8482-8855-4efd-ab42-c91ce756cc31 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.055512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.056216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.056497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.056769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.057613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:08.057846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.057987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.058482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.058774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.059048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.059371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.076181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 340/668] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:08.076181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.136489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.138143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.183862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65133f39-48ff-404a-b9cb-202189e4c83e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.218923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.219601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.219916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.220195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.230427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.232969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.234482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.237451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.250649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 329/669] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:08.251350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:08.251460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:08.252382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:08.253913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:08.253913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.253913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:08.253913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 341/670] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:08.253913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.357543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac5c778-e670-4ffe-b1f2-db13ffbbe36f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.369242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e2c53-aea2-4060-894b-cb7572a416c2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.393797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.394453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.394736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.395009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.404340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.404947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.405240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.405344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.405521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.406269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:08.406585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.406743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.408042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.424457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 342/671] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:08.424457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:08.424760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:08.425632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:08.426648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:08.426648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.426648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:08.426648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 330/672] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:08.426648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.492261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.499736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.557746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47d43f-c14d-42bd-ba38-de84d318c4e3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.561139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf87f55-203d-4822-a7d2-6d353d9cca5b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.601917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.602632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.602910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.603183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.608545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.609519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.610026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.610546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.611965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:08.612454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.614800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.614914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.616296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.631139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 331/673] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:08.631940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:08.636570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:08.637513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:08.638825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:08.638825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:08.638825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:08.638825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 343/674] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:08.638825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.751471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8124a-982f-48b7-836a-558a3fbf76c6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.760841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0279e-f48b-4d99-bc7d-341fe957311e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.761410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.774217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:08.795541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.796296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.796582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.797160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.798225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:08.798537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.800024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.801540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.802134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.802759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.802869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.809954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.811339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.812286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 332/675] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:08.813124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:08.825959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:08.826898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:08.827788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:08.828228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 344/676] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:08.829473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:08.934140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d07305e-74b6-4f89-94e6-bcf97751be79 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.941466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143f093-70c6-4831-95b7-41cbde2a46a1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:08.972226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.973205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.973788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.974410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.975250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:08.975762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.977303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.979123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:08.979761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:08.980044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:08.980320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:08.989106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:08.990574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:08.992265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 333/677] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:08.993281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:09.008046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:09.009035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:09.010009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:09.012205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 345/678] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:09.013166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.032378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.049462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.136823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bef4953-2260-47ee-8494-292d21e5ee67 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.137579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd87755-17b4-46ff-8b70-f1031c674e71 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.173182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.174119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.174543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.174956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.175831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:09.176265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.177204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.177977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.178204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.178445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.178823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.186028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.187751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.191108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 334/679] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:09.192075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:09.201418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:09.202523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:09.203695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:09.209940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 346/680] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:09.210878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.289022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.304597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2c07-46cd-4e41-92ef-2e2c9960500d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.327574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.349338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.350374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.350588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec20cb-00d1-465b-a145-5123809303d5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.351099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.351606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.352902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:09.354463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.356328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.383929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 335/681] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:09.385465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.390221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.390221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.390221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.390221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.390747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=943c65ab7c814cc690876b3ba9293756) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:09.391060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.393111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.399914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 347/682] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/role_assignments?user.id=943c65ab7c814cc690876b3ba9293756&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:09.400719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.552411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cebf81-ddb7-4ccf-84e3-7f43452c810e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.558681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afceddba-e95e-4400-ad20-72d77f6d30ce None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.602373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.603011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.603297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.603575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.609610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.610420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.610698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.610968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.611729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:09.612034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.613622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f45b0-f815-45d9-a8f6-6e55acd8e6f2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.626417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 336/683] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:09.627645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2aaf-d853-49dd-abb6-762073d0c178 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.627928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2aaf-d853-49dd-abb6-762073d0c178 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.628197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbc2aaf-d853-49dd-abb6-762073d0c178 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.629632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 337/684] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:09.630106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.639823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.640661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.641673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.649809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.662557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:09.663883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:09.693459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.695263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.738061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 338/685] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:41:09.738935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.825744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 348/686] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:09.831665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:09.906853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56c21c-f76c-4e40-9631-1e571ffdb89c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.920579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.949067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:09.949830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:09.950229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:09.950610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:09.951475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=ba3e762164ac406bbdd85ff1185c53c5) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:09.951888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:09.953783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:09.955655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:09.972477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9c6492-f3ec-4b6f-8cac-d4a0a473ce37 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:09.974219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 339/687] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/role_assignments?user.id=ba3e762164ac406bbdd85ff1185c53c5&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:10.010551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.011462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.011922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.012353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.023900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.025592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.028644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:10.042675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:10.043680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:10.044584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:10.044584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:10.044584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:10.046389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 349/688] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:10.052068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.198377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb7fb7d-28e6-4082-8391-d34fdd805c4b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.202044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:10.243983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.244591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.244871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.245142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.245780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:10.246155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.247500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.259532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31595186-9628-4b6c-aa09-38385a518531 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.269380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 350/689] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:10.278852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.309590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.310848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.311140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.311417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.312297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.314948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:10.330513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:10.331588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:10.332423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 340/690] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:10.338825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.399911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8557cb7d-8114-4563-ba38-838e9c896361 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.437194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.437855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.438167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.438997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.447149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.448647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:10.461153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:10.462183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:10.463064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 351/691] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:10.471179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.472572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:10.500066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:10.553892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f6213e-445f-4534-a48b-dde63adcb06f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.577985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514962-089f-4b60-a997-53f48082b34f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.610764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.611812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.612346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.612828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.613671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:10.615167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.616783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.624437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 341/692] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:10.630627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.646812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.648305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.648796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.649374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.650576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:10.651099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.652737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.681110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 352/693] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:10.691454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:10.789113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b701f2-6101-4a4e-b9dc-4e50e9acb203 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.847531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:10.864146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.864840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.865129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.865409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.868563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:10.868876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.870329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aece6e02-ebf7-492b-bc9b-0e9202692534 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.873732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:10.887748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 342/694] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:10.901244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa3433-e2b5-4fe7-94f0-2c7054ebbc2a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:10.943338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:10.943962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:10.944249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:10.944534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:10.945273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=833561908cfb4105b9851563d4253138) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:10.945588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:10.947132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b6ae8-b79c-4669-80ec-1e4011d738b0 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:10.954722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 353/695] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:10 2022] GET /identity/v3/role_assignments?user.id=833561908cfb4105b9851563d4253138&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:11.044561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ced1-487b-4175-90e2-334dc37c8552 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:11.044865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ced1-487b-4175-90e2-334dc37c8552 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:11.045033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740ced1-487b-4175-90e2-334dc37c8552 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:11.046688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 343/696] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:11.052807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:11.053097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:11.053377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:11.087163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:11.088494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:11.188533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 354/697] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 16 01:41:11.474129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740ced1-487b-4175-90e2-334dc37c8552 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:11.608081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740ced1-487b-4175-90e2-334dc37c8552 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:11.663171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:11.663818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:11.664106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:11.664386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:11.679038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:11.683835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:11.684798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:11.685682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:11.688136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 344/698] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:11.696348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:11.780364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:11.803886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89821575-4813-4e41-8d6b-5074b1c8b880 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:11.839026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:11.839641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:11.839930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:11.840210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:11.840873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:11.841188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:11.842582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:11.851837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 355/699] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:11.858933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:11.934462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:12.007761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b505385-b078-4b9e-aa0a-502e362f2152 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.053017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.053598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.053895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.054175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.070660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:12.072179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1599d4cb-8d1f-4554-b4a0-8599f6d3e3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:12.092658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:12.093733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:12.094771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:12.094771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:12.094771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:12.094771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 345/700] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:12.099660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:12.174079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25771ff-77d4-4aca-ae8d-08394de948e9 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.174364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25771ff-77d4-4aca-ae8d-08394de948e9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.174664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25771ff-77d4-4aca-ae8d-08394de948e9 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.176350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 346/701] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:12.181048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.181337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.181618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.209903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:12.211650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:12.248857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bdcbf-eb15-47c5-993f-a35cf5a60e17 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.313733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.314339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.314622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.314896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.315597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:12.315909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:12.317284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:12.333975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:12.340870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 347/702] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:12.346293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 356/703] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:12.347902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:12.385238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:12.480626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93018ca3-e20f-4c02-835e-8afbc7e45f1d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.524390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.525035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.525319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.525596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.533125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:12.534642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:12.546383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:12.547310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:12.548301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:12.550730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 348/704] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:12.553588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:12.681259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:12.683961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f50b40-21d7-4ff4-a6e9-da4510a980d7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.736322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.737734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.738259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.738735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.739679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:12.740189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:12.744064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:12.774816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 357/705] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:12.780308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:12.857271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:12.872589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:12.892619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2b8ae-e747-4606-aae3-bf46ffbb7e22 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.902144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf14ae-108f-4c08-a67f-30530257e6f1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:12.946261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.947102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.947555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.947772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:12.948155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.948583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.948968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.949335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.962257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:12.963908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d8e82dbd-23ad-44c5-a09f-16ab74ec887f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:12.978732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:12.979888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:12.980863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:12.980863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:12.980863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:12.982661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 349/706] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:12.984002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8db2-6760-4723-ad45-f910cf9659d4 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:12.984470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8db2-6760-4723-ad45-f910cf9659d4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:12.984941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce8db2-6760-4723-ad45-f910cf9659d4 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:12.991370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 350/707] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:12.992375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8db2-6760-4723-ad45-f910cf9659d4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.030062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.031605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e0206-6bef-4b70-945b-4345a6601e57 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.093237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:13.143184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 358/708] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:13.144822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.145063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce8db2-6760-4723-ad45-f910cf9659d4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.145510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.145989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.167317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:13.168829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:13.194862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.196031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.196976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.197699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.198903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:13.199397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.201570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.218858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 351/709] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:13.220506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.224330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:13.248466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 359/710] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:13.249721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.399727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:13.400856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacc750-4e90-4bc9-9db3-8deccf7eb91f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.417068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea6588f-c094-4ad3-98e5-696d37a536c9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.455751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.456336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.456614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.457043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.458098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.459846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.486187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 360/711] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:41:13 2022] POST /identity/v3/users => generated 254 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:13.503524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.504250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.504476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.504752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.526588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.528138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:13.555723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:13.556803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:13.557747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:13.557747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:13.557747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:13.558407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 352/712] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:13.563100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.591012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.698501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ac4135-c4cc-4351-9bea-460ed4de02ea None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.700524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:13.739715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e731315-b114-429b-be04-480779e9713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.739715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731315-b114-429b-be04-480779e9713b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.740306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731315-b114-429b-be04-480779e9713b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.740306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e731315-b114-429b-be04-480779e9713b None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.740737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731315-b114-429b-be04-480779e9713b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:13.741045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731315-b114-429b-be04-480779e9713b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.742489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e731315-b114-429b-be04-480779e9713b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.755341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 361/713] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:13.756755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f17-7387-4685-9f97-78915bda9015 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.757052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f17-7387-4685-9f97-78915bda9015 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.757331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b40f17-7387-4685-9f97-78915bda9015 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.758946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 362/714] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:13.762001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eed33d-230a-47e7-8931-0acedb9363d3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.764205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40f17-7387-4685-9f97-78915bda9015 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.769300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:13.814737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.815392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.815811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.815983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.816540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.817983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-715782d5-0b7c-49f4-af4e-eb3e5f8d4da4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:13.832316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:13.833390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:13.834295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 353/715] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:13.836323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.836534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.836959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.857482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:13.858896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:13.904717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b40f17-7387-4685-9f97-78915bda9015 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:13.940859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 354/716] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:13.942000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.948197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:13.948709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.948989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.949263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.963256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:13.965677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f8bf9f89-5bd3-428c-a6bb-caea7059ee90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:13.983806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:13.984732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:13.986313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:13.989256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 363/717] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:13.991615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92688b3-00ef-4d9b-965c-846f7ae162d9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:13.992362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92688b3-00ef-4d9b-965c-846f7ae162d9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:13.992853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92688b3-00ef-4d9b-965c-846f7ae162d9 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:13.995389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 364/718] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:13.996645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92688b3-00ef-4d9b-965c-846f7ae162d9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:13.998820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.056877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e74bf8b-0c94-4ae7-a8b6-30c0b0a07eb7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.080198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.095124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.095872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.096254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.096647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.097374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:14.097806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.099393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddff88b-7703-4dd2-ae1e-e028f73023b4 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.108029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 355/719] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:14.112168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.112168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.112168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.135998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:14.138105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:14.144824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92688b3-00ef-4d9b-965c-846f7ae162d9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.184435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.184435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.184435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.184435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.184859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:14.184928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.186377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.204090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 365/720] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:14.204996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:14.232989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 356/721] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:14.234698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:14.314880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.327541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d923ff21-7e61-4f56-9c5a-dd42b7c5e6a1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.352048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.365836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.366473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.366752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.367024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.367645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] RBAC: Adding query filter params (type=network) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:14.367946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.369295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.377396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 366/722] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:14.378299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:14.392408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51779ee-b605-4b40-80ee-75c08029bed9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.470449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.471858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.472634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.473426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.477660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:14.478365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.482198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.504037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 357/723] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:14 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:14.531694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:14.557176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c0f7e9-cfdc-422b-a231-264141dba827 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.607787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.608700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.609161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.609582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.610517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.612329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.640815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 367/724] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:14 2022] POST /identity/v3/services => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:14.710204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2060f99-9fbe-451f-92f8-7995a4f87edb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.722191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.759003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.759720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.760003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.760275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.772998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:14.778685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:14.779687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:14.780563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 358/725] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:14.788456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:14.849643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:14.915796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b516821-3c9c-4a01-ba68-c62b13ef2c51 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:14.956051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:14.956676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:14.956969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:14.957253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:14.957943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:14.958254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:14.959629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:14.968993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 368/726] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:14.974739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:15.121790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22107470-88e1-4cc8-a96f-d49e93d81fa7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:15.169635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:15.170691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:15.171183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:15.171689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:15.183264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:15.184985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:15.200040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:15.201046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:15.202020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:15.202020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:15.202020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:15.204627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 359/727] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:15.210340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:15.318827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3293-db4e-4744-becb-0811273efc3f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:15.337495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:15.375813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:15.376352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:15.376634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:15.376909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:15.377554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:15.377860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:15.379260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:15.403190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 369/728] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:15.409244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:15.441156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:15.557500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453b4f3-6a75-4968-8d63-8a207256e34c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:15.596330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:15.596958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:15.597233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:15.597505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:15.605964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:15.607410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:15.626180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:15.627199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:15.628165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 360/729] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:15.635416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:15.816000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205df1e-b27f-4af1-b74a-23c0d354e587 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:15.861364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:15.862001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:15.862282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:15.862548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:15.863269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:15.863572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:15.864983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df23595-4cdb-41ea-8320-1bdf32cbeee4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:15.892088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 370/730] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:41:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:15.897626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:15.981888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:16.016293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9ca83-414b-4a9a-ac34-3aea02fb2d4d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:16.068407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:16.069016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.069291 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.069558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.147996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:16.149463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:16.213813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861444c5-9508-4b7e-a109-255041534a4d None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.214165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861444c5-9508-4b7e-a109-255041534a4d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.214388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861444c5-9508-4b7e-a109-255041534a4d None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.215707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 371/731] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:16.221428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.221718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.222157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.239796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:16.243462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:16.244713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:16.286209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:16.291427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 361/732] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:15 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 16 01:41:16.297071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:16.355124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 372/733] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:16.447747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9613f3-fe48-443c-a109-6103041483eb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:16.487982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:16.488607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.488882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.489158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.499697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:16.501298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:16.520762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:16.521733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:16.522689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:16.522689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:16.522689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:16.522689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 362/734] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:16.529067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:16.651722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20ebb3-e033-4676-8ef3-77cff12fd469 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:16.694159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:16.694835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:16.695447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.695796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.696073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.696997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:16.697310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:16.699686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:16.711943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 373/735] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:16.720296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:16.750223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:16.756478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:16.871824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864444d1-bd20-46bb-9187-1f9ad573aa28 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:16.897177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13dc-adea-4762-bca6-fbbd059e3dfc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:16.926911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:16.927750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.928030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.928301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:16.941390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:16.944135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:16.963207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:16.964226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:16.965140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 374/736] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:16.970081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:16.971703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:16.972407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:16.972815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:16.973086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.002431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:17.007728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:17.009906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:17.011953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 363/737] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:17.019618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.120614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.158870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8802fd-e8d4-4aec-94a5-c4e2cb731d35 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.207373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.224519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ada85-0cb5-4233-9209-246def6d82da None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.226647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:17.228089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.228369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.228640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.229336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:17.229639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:17.231110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3d429-849a-4760-9626-fdbf1c46288f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:17.247396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 375/738] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:17.248494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4dc6-a666-45d1-8c99-17f3646eb45d None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.248777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4dc6-a666-45d1-8c99-17f3646eb45d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.249048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697d4dc6-a666-45d1-8c99-17f3646eb45d None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.250394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 376/739] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:17.254619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91baf-feab-48dc-9f8a-e134058c18ee None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.254913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91baf-feab-48dc-9f8a-e134058c18ee None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.255232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f91baf-feab-48dc-9f8a-e134058c18ee None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.256563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 377/740] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:17.257682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3448674-3176-4a0c-87ab-d02b01b0612f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.260855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3448674-3176-4a0c-87ab-d02b01b0612f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.260855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3448674-3176-4a0c-87ab-d02b01b0612f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.275011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:17.275629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.275912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.276187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.276851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:17.277158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:17.279018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:17.284496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a3448674-3176-4a0c-87ab-d02b01b0612f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:17.285677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a3448674-3176-4a0c-87ab-d02b01b0612f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:17.289925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 364/741] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:17.289925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.365893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 378/742] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:17.365893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.365893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.365893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.381478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:17.382791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:17.400763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e304ab-d1bb-46f0-b4b5-d7fa5ebee65a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.446131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:17.446992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.447283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.447566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.448983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=833561908cfb4105b9851563d4253138) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:17.449308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:17.450437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.452986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ee210-cfac-4b23-bf33-a1e0805759e5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:17.462605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 379/743] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:17.462605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.471081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 365/744] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:17 2022] GET /identity/v3/role_assignments?user.id=833561908cfb4105b9851563d4253138&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:17.581623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c6199-5d77-43b5-ac9d-dc9da81bfa09 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.618172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:17.618893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.619177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.619450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.623705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f84f-1e7a-4014-b1a7-934074e75e40 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.623999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f84f-1e7a-4014-b1a7-934074e75e40 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.624286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a4f84f-1e7a-4014-b1a7-934074e75e40 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.626455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 366/745] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:17.630673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4f84f-1e7a-4014-b1a7-934074e75e40 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.636188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:17.637665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:17.649308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-8c698b69-7f8d-4427-8961-44ab89ce27bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:17.657398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:17.658460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:17.659362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:17.659362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:17.659362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:17.659362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 380/746] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:17.660319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.660319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.660492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.680329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:17.681565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:17.734450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.758541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a4f84f-1e7a-4014-b1a7-934074e75e40 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.761945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 381/747] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 16 01:41:17.763107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.813726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:17.814987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:17.815468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:17.815990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:17.817977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:17.819607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:17.846598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 367/748] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:17 2022] POST /identity/v3/services => generated 240 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:17.847429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:17.923811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242b0f4-5c73-4f3c-bc60-bbcc25f41156 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:17.958430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:17.984285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d7ca6-fbec-44c7-967e-dc4c2ca61831 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.007941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.008645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.008934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.009211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.009896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:18.010199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.012681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.026837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 382/749] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:18.032969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.065105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.065755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.066064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.066347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.090059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:18.095734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:18.096702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:18.097574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:18.100197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 368/750] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:18.106501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.106829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.183541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3504270-5749-413c-b1b6-49907e39ecf9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.225887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.227420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.227907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.228564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.233061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc81af91-cca7-48dd-9177-2f720804e0d0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.239368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.241055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:18.256203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:18.257183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:18.258187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:18.259684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 383/751] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:18.263249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.283892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.286927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.288104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.288564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.289315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.290577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:18.291079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.292669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.306862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 369/752] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:18.308002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.390519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.396814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17750f90-b810-4017-abcb-00dd795e82ad None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.435160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.435762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.436046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.436321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.437140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.438924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.447504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39a2bf-8670-4a9b-b445-b3431bc40453 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:18.455696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:18.456699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:18.457538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:18.459593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 384/753] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:18.460555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.504190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.504806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.505146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.505424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.506240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:18.506552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.508020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.531255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 370/754] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:18.531255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.593105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0e070-fea9-4c6d-a702-000a007a377f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.608471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.630348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.630987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.631329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.631605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.642801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.644197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:18.660109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:18.661106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:18.662047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:18.662047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:18.662047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:18.666165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 385/755] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:18.667050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.681585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a58fffd-3627-4c89-b270-d5b1c9f49468 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.687524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.724068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.724844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.725457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.725673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.726431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:18.726826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.728381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.738018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 371/756] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:18.739049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.794099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98459cfd-986d-4f8b-b8fb-d8bae26b7c4d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.842406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.843029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.843307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.843576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.856582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd99bdf-8bbf-42a6-a53e-0cf1570df957 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:18.873624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:18.907809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:18.908487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:18.908769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:18.909038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:18.909679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:18.910054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.912103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.928194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 372/757] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:18.929090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:18.935197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:18.937213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:18.964138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.061255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadbf8-2ff4-4276-8ebd-759338724b85 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.072399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 386/758] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:19.073600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.098057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.098946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.099406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.099858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.100682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:19.101190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.102782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.108187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 373/759] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:19.109301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.150157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.182437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68d930-4500-431c-9db4-2ad1b9c3d76e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.202267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.215856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6a35af-4965-4dbf-9cfc-21f980ba3deb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.224077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.225044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.225564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.226157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.234298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.236665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:19.249470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:19.250576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:19.251541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:19.252081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.252682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.252779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.253013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.254635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 387/760] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:19.255731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.265422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.266999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:19.282423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:19.283408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:19.284322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:19.284322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:19.284322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:19.284322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 374/761] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:19.284954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.379653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.380267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6585ee-fdb7-45a1-a690-6115b55cb717 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.390227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcf348-b1ab-4f5d-8f95-241f372b28d2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.419395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.420432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.420921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.421424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.422951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] RBAC: Adding query filter params (interface=public, service_id=f15ebcc07a2c43cc9cc02b28fd1b3ad8, region_id=RegionOne) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:19.423463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.425017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.425570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.426211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.426493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.426766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.427487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:19.427791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.429214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.436179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 388/762] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/endpoints?service_id=f15ebcc07a2c43cc9cc02b28fd1b3ad8&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:19.437278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.447985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 375/763] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:19.449148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.485459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.550330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed4486e-ba42-4cea-9986-2c79eb117226 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.551913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413795aa-b103-4037-9f4b-5f68929a9b34 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.587706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.588357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.588615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.588753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.588962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.589576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.590200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.590696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.591009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.591395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.592369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:19.592976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.595255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.597610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 376/764] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/services => generated 772 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:19.599042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.609699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 389/765] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:19.614874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.615516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.750323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212244c0-60a1-4438-a3a1-6412d8910a0c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.790267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:19.793633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c589a0-5e78-4e61-a887-834d00759973 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:19.825018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.825689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.826003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.826278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.842494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.849912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.865213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:19.866275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:19.866755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:19.867231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:19.868355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:19.869589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:19.870516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:19.870516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:19.870516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:19.870516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 377/766] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:19.875028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.878613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:19.880363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:19.897791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:19.898821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:19.899751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:19.900182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 390/767] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:19.904661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:19.956852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.004482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb879e5d-ebfa-4b4b-a4e9-737ad1a1d31e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.021830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73528b82-ba73-4a4a-92d6-c300db9a45aa None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.047903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.048519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.048795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.049064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.050000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:20.050305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.052395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9423c74e-b8ca-4296-ae7b-bdcb8d133c5d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.065967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.066617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.066727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 378/768] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:20.066933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.067177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.067882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:20.067989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3184d-b834-417b-af8e-f36e4ad9143d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.068164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3184d-b834-417b-af8e-f36e4ad9143d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.068275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.068430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3184d-b834-417b-af8e-f36e4ad9143d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.069627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df32c681-d79b-4540-afc2-a694acd61fe0 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.071453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 379/769] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:20.079169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3184d-b834-417b-af8e-f36e4ad9143d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.097419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 391/770] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:20.100116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.100526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.101181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.122471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:20.124239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:20.140779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.200317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf3184d-b834-417b-af8e-f36e4ad9143d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.205701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 392/771] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:20.206637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.225139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.239471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.240238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.240619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.240992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.247935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.249494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fa29a77e-6146-4142-8118-0d67306b59a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:20.262271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:20.263406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:20.264840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:20.270209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 380/772] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:20.271567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97a1-095f-46c3-98c7-b2deee6c4fab None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.271948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97a1-095f-46c3-98c7-b2deee6c4fab None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.272305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f97a1-095f-46c3-98c7-b2deee6c4fab None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.273907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 381/773] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:20.276331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f97a1-095f-46c3-98c7-b2deee6c4fab None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.338783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a23e7-f5d5-4002-af13-6596f9d1e604 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.378923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.379835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.380333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.380785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.381690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=1a82594a77b542e5be1ea542cbfdf70b) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:20.382246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.383868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c718a-4684-4474-8a90-f8ca29f46a5c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.398247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 393/774] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/role_assignments?user.id=1a82594a77b542e5be1ea542cbfdf70b&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:20.400678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.401177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.401666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.417432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012f97a1-095f-46c3-98c7-b2deee6c4fab None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.446750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:20.451135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:20.471330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.487689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.494777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.495180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.495839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.496375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:20.496797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.498719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.512772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 382/775] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:20.518735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.555247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 394/776] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:20.556318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.567567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.636496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb701aa-ff97-4b2b-ba0b-76ad2ff453a3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.683365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.684264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.684718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.685145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.700548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8dea3-cc62-4dab-a153-a512d9090e53 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.701961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:20.709045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:20.710353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:20.711209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:20.714222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 383/777] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:20.721903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.754657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.756367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.759569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.760037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.762244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=6e5607c5bb0f43cc9e79e6e0351077a0, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.765129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.791222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 395/778] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:20 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:20.870382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c6c5d-808e-4c0a-aec0-2d8682c177e6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:20.874284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.914957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:20.915944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:20.916411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:20.916867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:20.917737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:20.923064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:20.924793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:20.935071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 384/779] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:20.942530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:20.951161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:20.960601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.101855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9aa9-133a-4651-a40b-a2d0f5a7710e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.119004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254105b-1a61-45c7-9621-6b1b36860444 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.145225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.145861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.146166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.146438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.161834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.163316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.163520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.164353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.164638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.164947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] PATH_INFO: `/v3/services/network` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.165754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.167624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:21.177935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:21.178953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:21.179801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:21.180552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 385/780] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:21.186724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:21.186857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:21.187711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:21.189845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:21.189845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:21.189845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:21.192598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 396/781] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:21.193694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.246555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:21.297549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:21.380806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d523577-bee3-43fd-8487-fdb78d80ace2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.382822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0817fda-3218-4a48-a06f-42f26234e969 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.443481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.444102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.444383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.444656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.445288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] RBAC: Adding query filter params (name=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:21.445591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.447002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.450903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.451515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.451795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.452069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.452715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:21.453023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.454458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.460126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 386/782] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:21.465106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.486001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 397/783] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:21.493205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.653194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:21.663618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b87736-1208-47ea-b9b5-732a97496c1f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.684552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2f40a-8bfb-439f-9485-f657c249d47c None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:21.717301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:21.737746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.738511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.738795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.739067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.739701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] RBAC: Adding query filter params (type=network) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:21.740004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.741381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.752789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 387/784] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:21.753518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:21.754194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:21.754532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:21.754809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:21.757749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.771690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:21.775443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:21.795750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:21.796740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:21.798269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:21.809438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 398/785] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:21.810633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:21.978993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c46b14f-b9c3-433b-a4d2-5cf96b536284 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.004220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b65f34-9fe8-462f-b650-1563429d089a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.034566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.035143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.035422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.035756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.036465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] RBAC: Adding query filter params (interface=public, service_id=646546ede59b4910b2f057cffa6f5bd4, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:22.036774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.038167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dfdad2-5a63-4307-8346-1c477f295dc7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.045340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.046248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.046728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.047235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.048235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:22.048737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.050403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8103b60-7445-424c-bfdb-a1dbea50e351 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.050970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 388/786] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/endpoints?service_id=646546ede59b4910b2f057cffa6f5bd4&interface=public®ion_id=RegionOne => generated 194 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:22.052214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783533b9-62c7-4ee6-abee-97ed3760c2ac None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.052502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783533b9-62c7-4ee6-abee-97ed3760c2ac None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.052782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783533b9-62c7-4ee6-abee-97ed3760c2ac None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.054483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 389/787] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:22.058479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783533b9-62c7-4ee6-abee-97ed3760c2ac None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.075889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 399/788] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:41:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:22.075889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.075889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.075889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.089465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:22.093216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:22.095263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:22.124259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:22.169626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 400/789] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:22.174321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.182539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783533b9-62c7-4ee6-abee-97ed3760c2ac None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.241044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.241962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.242390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.242905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.243702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.245348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.258649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 390/790] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/services => generated 772 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:22.287549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e97e6a-0222-4226-acc1-bc53991f5a3a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.326612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.327632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.328108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.329247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.341306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.343159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:22.359092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:22.360151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:22.361047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:22.361047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:22.361047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:22.363316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 401/791] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:22.369124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.503266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:22.524137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58e216-0a93-4920-a4dd-725f98175e6f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.559026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.559633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.559915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.560186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.560825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:22.561132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.562535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.579916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 391/792] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:22.586045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.607308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:22.624661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.749275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bab162-75e6-4e71-ab4d-0294dbaa91f9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.810350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.811572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0467122b-7dd7-4966-ae89-9475d5fa3034 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:22.812492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.814915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.815441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.830474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.832233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:22.860278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:22.861248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:22.862201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:22.864816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 402/793] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:22.870786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.902557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:22.904317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:22.904824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:22.905639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:22.907174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:22.910310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:22.926414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:22.927490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 16 01:41:22.928362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:22.939315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 392/794] 10.222.0.33 () {56 vars in 1129 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:22.947633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:22.973665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.003078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.025426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ae54c-65c0-47cb-b2c1-b9b7e1471299 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.062095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.063494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.063933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.064346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.065173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:23.065620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:23.067197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73930984-a35a-4b8b-9312-c26a59d6ab43 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:23.085198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 403/795] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:23.086991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3e1b2-d513-4b62-9d6e-b073a06695cf None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.087419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3e1b2-d513-4b62-9d6e-b073a06695cf None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.087834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf3e1b2-d513-4b62-9d6e-b073a06695cf None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.089539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 404/796] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:23.094714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3e1b2-d513-4b62-9d6e-b073a06695cf None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:23.096247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902b409-2b84-4d90-97b7-9dba27690719 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.137919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.138621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.139233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.139572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.140263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:23.140632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:23.142599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c109f9-1f8b-43bd-9e3a-c5439847ee95 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:23.149070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 393/797] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:23.150605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.151092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.151489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.174100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:23.176044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:23.217478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf3e1b2-d513-4b62-9d6e-b073a06695cf None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.263238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 394/798] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:23.264459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:23.282377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.283409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.284329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.284618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.284917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/833561908cfb4105b9851563d4253138/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.287332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=833561908cfb4105b9851563d4253138, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:23.288392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e09217-0b16-4ed0-af40-de6afca968b2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:23.292199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.308711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 405/799] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:23 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/833561908cfb4105b9851563d4253138/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:23.344700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda301-d946-4000-881a-d2d02ffdd1cf None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.344876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda301-d946-4000-881a-d2d02ffdd1cf None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.345112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fda301-d946-4000-881a-d2d02ffdd1cf None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.351464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 406/800] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:23.367415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.367773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.367977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.395589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:23.396818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:23.411083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc973e4-0ed2-4cc1-a8c4-7adeb507e4ed None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.453001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.454532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.455175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.455776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.456628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:23.457136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:23.458773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:23.465124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 395/801] 10.222.0.33 () {56 vars in 1124 bytes} [Fri Sep 16 01:41:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:23.470781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:23.552405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 407/802] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:23.589228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.616309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:23.627445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73056b40-691f-4772-8eb0-6fb44bec620f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.668260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.670370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.670662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.670939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.671618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:23.673553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:23.700325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 396/803] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:23.742043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3d9ca-50f5-477c-b187-86c342b39c84 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:23.773108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:23.804593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:23.805553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:23.806038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:23.806453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:23.825926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:23.831839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:23.833058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:23.834158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:23.836722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 408/804] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:23.843292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:23.969134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.003710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52f68b-b45f-4af0-b14b-8d42c77c15c1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.038140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:24.054739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.055813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.056299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.056774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.057645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:24.058338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.060103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.069296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 397/805] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:24.075564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.102842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac58fce-76a4-4699-a7db-f7a88be76691 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.141892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.142657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.142936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.143205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.154045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:24.159697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:24.160625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:24.161684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 409/806] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:24.168712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.192932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76441368-3624-4128-83e8-d39da9e57605 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.222753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:24.228773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.229426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.229705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.230025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.249294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.261293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:24.286322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:24.287355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:24.288256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:24.288256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:24.288256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:24.288256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 398/807] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:24.293052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.298560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c262db1b-23b1-4cb8-8e76-a72e2b804b20 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.335222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.336193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.336695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.337164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.338058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:24.338574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.340344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.350492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 410/808] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:24.360540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.363843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:24.470807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c748727-c3b3-4a8e-8093-c0bbc6f3a305 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.510847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e47103-5cb4-4eeb-ae14-d20fafe736f4 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.514507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:24.516497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.517141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.517420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.517695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.518375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:24.518681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.520098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.547210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 399/809] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:24.554394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.599151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.599798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.600080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.600352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.726354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:24.736953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f09c6a4-b5a8-4527-b835-8f8416adf197 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:24.793051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.794871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:24.810682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:24.811650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:24.812654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:24.812654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:24.812654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:24.815394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 411/810] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:24.820627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:24.826498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:24.827479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:24.827968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:24.833250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:24.844731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:24.846482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:24.866535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:24.867516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:24.868465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:24.870941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 400/811] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:24.880031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.027782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71618bd3-0db9-4d3d-b0c2-5ce4a2dbacdf None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.052314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfb930-c2bc-4fe9-a1c2-69f58901019b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.066898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.068000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.068352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.068942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.069654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:25.070149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.071803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef919c-266b-4937-8151-bf3192e5b492 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.086417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 412/812] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:25.087708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1ef-9b7f-4cb4-8614-a59b6e8efc3e None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.088001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1ef-9b7f-4cb4-8614-a59b6e8efc3e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.088276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c071a1ef-9b7f-4cb4-8614-a59b6e8efc3e None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.093599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 413/813] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:25.094908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a1ef-9b7f-4cb4-8614-a59b6e8efc3e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.097707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.098363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.099519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.099811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.100554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:25.100868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.102502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bedad-5ae9-4d48-9213-afc40f3aefac None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.114236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.130001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 401/814] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:25.131769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.133318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.134584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.157062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:25.158838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:25.172461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.210769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c071a1ef-9b7f-4cb4-8614-a59b6e8efc3e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.247454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.248787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.249286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.249684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.250021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 402/815] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:25.250959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.259577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.261197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:25.273771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:25.274927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:25.275869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:25.283809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 414/816] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:25.289905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.419300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.442771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff818aab-01ba-4839-91de-8d1b7ed6eafa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.455904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ec15a-3074-4e5b-aa0c-ec922ee31d1b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.508433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.510077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.510717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.512331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.525247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.526194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.526674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.527139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.528206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:25.528718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.530059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.530676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.531586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.545501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:25.561150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:25.562171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:25.563163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:25.563163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:25.563163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:25.568581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 403/817] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:25.576092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 415/818] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:25.576435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.581188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.724480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32592e5f-55a7-4894-968c-d1a64caf06e1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.732415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91454ec-bbae-4826-a1d3-34085ef8ee21 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.763650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.764296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.764532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.764788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.768190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.775561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.777374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.777937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.778477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.779473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:25.780015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.782365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.798187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 404/819] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:25.799508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.852555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.854057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9de68-c347-4ad1-b897-ac2637c08930 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.866157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:25.913505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b3724-e3d5-4b4d-a49e-dfa3b94bbf72 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:25.950435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:25.951079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.951357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.951630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] PATH_INFO: `/v3/services/network` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.952212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:25.953609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:25.962633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:25.963660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:25.964513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 405/820] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:25.965304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:25.970249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 416/821] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:25.971181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba73b-db4b-42ea-a525-9c9b49873248 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:25.971475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba73b-db4b-42ea-a525-9c9b49873248 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:25.971753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ba73b-db4b-42ea-a525-9c9b49873248 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:25.977545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 417/822] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:25.977545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba73b-db4b-42ea-a525-9c9b49873248 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.014909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.075210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bda11-dff2-4e03-91dc-d922013ffe19 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.090708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ba73b-db4b-42ea-a525-9c9b49873248 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.098532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.111835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.112231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.112507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.112776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.119772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.121479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.129269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.129954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.130262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.130537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.131154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] RBAC: Adding query filter params (name=network) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:26.131451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.132776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0e63df40-6a32-4803-8028-34ca02121e78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:26.132875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:26.133724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:26.134660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 406/823] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:26.135775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.135775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.135775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.143106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 418/824] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:26.143750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.160698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:26.161936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:26.235281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 407/825] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:26.236528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.264727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.284882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dccba-1171-463f-82ee-d04d319727ce None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.321467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.322157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.322439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.322714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.333500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.334959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:26.349167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:26.350154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:26.351075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:26.351075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:26.351075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:26.351075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 419/826] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:26.351305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.366103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf3a86-f238-48f7-b05a-4a28dfadf0c7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.381192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.404927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.405625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.405941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.406223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.407016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:26.407329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.409051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248c53e-4b8c-4228-8356-a4914df812f9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 408/827] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c23f-d957-4365-94bd-d79317bd7147 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c23f-d957-4365-94bd-d79317bd7147 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8c23f-d957-4365-94bd-d79317bd7147 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 409/828] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:26.425896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c23f-d957-4365-94bd-d79317bd7147 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.460898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cacf2-f00e-488c-a4c8-f6e6b465b82b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.495235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.495785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.496074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.496359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.496976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:26.497283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.498664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.503445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 420/829] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:26.504196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.524342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.535588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8c23f-d957-4365-94bd-d79317bd7147 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.568773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.569381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.569661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.569970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.570607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:26.570916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.572274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721cab4-fef0-4ff1-bfbb-b353b707c23a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.583616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 410/830] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:26.584854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.585153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.585475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.603161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:26.604356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:26.609971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7968f6-316e-4a1e-b458-b6aea5d166b8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.630093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.644896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.645556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.645837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.646147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/1a82594a77b542e5be1ea542cbfdf70b/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.661627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=1a82594a77b542e5be1ea542cbfdf70b, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.663143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.671854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 411/831] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:26.673268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.676164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 421/832] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:26 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/1a82594a77b542e5be1ea542cbfdf70b/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:26.676794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.755894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.790618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999114e-ffef-43dd-aea2-6a956dec7c75 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.825308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f059b-b9f0-4cac-9c63-4136cf65f3cd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:26.829759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.830509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.830860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.831204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.831959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:26.833486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:26.862714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 412/833] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:26.864095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:26.888673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:26.889666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:26.889988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:26.890265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:26.907063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:26.919059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:26.924685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:26.925723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:26.926712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 422/834] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:26.938943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.029486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06558d52-1dfe-4775-b4e0-5fbd45e9afaf None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.071646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.072626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.073007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.073690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.082902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.084430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.091341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdedfc-6cee-4d23-a123-b3cd5bf0c976 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.119975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.136287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.137069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.137415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.137753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.138533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.139159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.140627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.151231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 423/835] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.151968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:27.215290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:27.216282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 413/836] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:27.217206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.279566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78783c68-0970-4838-9295-9d87299dc495 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.302844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.319250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.319888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.320164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.320435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.321006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.322393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.326936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a62164-c01f-4ea7-bdf8-c198ee439389 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:27.331440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:27.332414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:27.333260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:27.337366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 424/837] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:27.338383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.365712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.366386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.366962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.366962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.378070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.379519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.390583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:27.395197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:27.396342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:27.397430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:27.397430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:27.397430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:27.401174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 414/838] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:27.402040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.450486 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbac1f45-548a-4887-bed1-deb35eb1f3ca None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.486227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.486830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.487141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.487413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.488265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.488572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.490380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.508328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 425/839] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.508328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.511674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283ed45-b919-4c23-9b46-f1f10960363c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.541938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.548927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.549621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.549999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.550346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.551082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.551423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.552850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.563195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 415/840] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.563195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.615034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffcf5be-82f1-480a-8592-24d873840ef9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.623074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.653024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.653722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.654038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.654307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.654939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.655355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.656733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.664071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e67883-8697-4505-99c0-24e5685323e8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.669062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 426/841] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.669682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.703127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.704262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.704545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.704814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.705550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.705875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.707368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.713677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 416/842] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.714582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.779854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:27.804063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d8adc9-0773-4eb4-8871-c2ab602f61f7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.839300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e44e4fc-b798-4aeb-8e86-65f3b33a82a3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:27.845840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.846490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.846774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.847051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.847686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:27.847994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.849369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.854764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 427/843] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:27.887292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:27.887963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:27.888244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:27.888520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:27.899208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:27.900715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:27.914200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:27.915227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:27.916796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 417/844] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:27.922795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:27.958525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:28.040423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285036a8-f8b5-43be-b8d8-d72376050c3e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:28.076474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:28.077012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:28.077298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:28.077576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:28.078340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:28.078650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:28.080094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:28.100197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 428/845] 10.222.0.33 () {56 vars in 1135 bytes} [Fri Sep 16 01:41:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:28.105721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:28.219569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5b87d-e345-4d2d-994d-b48d7adb9b22 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:28.238225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:28.255402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:28.256395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:28.256885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:28.257657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:28.328270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:28.330348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:28.438585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 418/846] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:28.446480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:28.537696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:28.550697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122326a0-bd33-4d22-86f0-b58061785049 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:28.585706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:28.586285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:28.586563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:28.586834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:28.597326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:28.598795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:28.614087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:28.615094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:28.616142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:28.616142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:28.616142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:28.616142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 429/847] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:28.623971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:28.643768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:28.751216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc58894-b996-492a-ac3f-65c69b07e0c6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:28.792587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:28.793191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:28.793466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:28.793733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:28.794392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:28.794692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:28.796041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:28.808230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 419/848] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:28.814908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:28.916785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00fdf81-339c-49c3-b556-720efe14ac05 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:28.956393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:28.957056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:28.957336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:28.957625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:28.965629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:28.967135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:28.970769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-08bfc1cb-eb72-4ad6-806c-68830e8386d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:28.980759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:28.981768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:28.982898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 430/849] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:28.989932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:29.080373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:29.107562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c819ee-d51f-4dc1-8c82-0fb32b8497f6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:29.108479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4285-40fe-4555-9e7e-70333aaa760f None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.108998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4285-40fe-4555-9e7e-70333aaa760f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.109552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d4285-40fe-4555-9e7e-70333aaa760f None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.113273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 431/850] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:29.117696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.118243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.118724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.142055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:29.143793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:29.148560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:29.149175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.149457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.149735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.150457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:29.150769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:29.152202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:29.170863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 420/851] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:29.173249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:29.238375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 432/852] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:29.302743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2644a00-235d-457a-b790-ede994e8b8aa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:29.337272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:29.337895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.338170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.338439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.339150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=833561908cfb4105b9851563d4253138) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:29.339456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:29.340863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:29.346891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 421/853] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:29 2022] GET /identity/v3/role_assignments?user.id=833561908cfb4105b9851563d4253138&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:29.518447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:29.624262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c195-2378-47bf-9d5e-49f5deb152af None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:29.653996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:29.660754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:29.661392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.661672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.661986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.672583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:29.677449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:29.678408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:29.679684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 433/854] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:41:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:29.684670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:29.688172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:29.794387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416ef4b-7161-4456-b146-f346286c9922 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:29.832106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:29.832760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.833045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.833322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:29.834045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:29.834353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:29.835720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:29.845075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 422/855] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:41:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:29.850382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:29.955665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d30721-2c86-4887-88ec-21a08f6db838 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:29.992028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:29.993074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:29.993557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:29.994074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.006531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.008378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-741d8363-47ca-4e17-aceb-ea93679cf99e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:30.026376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:30.027406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:30.028315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:30.028315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:30.028315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:30.030597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 434/856] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:30.038896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.108589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.149767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48661f-eea2-45df-95a1-2f9f13d1cbdf None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.150122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48661f-eea2-45df-95a1-2f9f13d1cbdf None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.150355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b48661f-eea2-45df-95a1-2f9f13d1cbdf None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.150937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df4d3-30a5-4cbd-8c5b-12044ee2a08a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.151816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 435/857] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:30.159896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3386-97f4-4098-b8e2-ac8a2b58f9ea None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.159896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3386-97f4-4098-b8e2-ac8a2b58f9ea None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.159896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd3386-97f4-4098-b8e2-ac8a2b58f9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.176989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9ccd3386-97f4-4098-b8e2-ac8a2b58f9ea None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:30.178217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9ccd3386-97f4-4098-b8e2-ac8a2b58f9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:30.188577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.189185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.189529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.189736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.190406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:30.190711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.192060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ebf077-02ee-49f2-bf38-ea26663414e2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.204036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 423/858] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:30.205062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5649d-8e36-4a64-a1c6-47a4483587a3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.205343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5649d-8e36-4a64-a1c6-47a4483587a3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.205610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5649d-8e36-4a64-a1c6-47a4483587a3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.209994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 424/859] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:30.211299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5649d-8e36-4a64-a1c6-47a4483587a3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.217563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.259736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 436/860] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:30.261921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.262477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.262898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.288164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:30.289629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:30.323666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5649d-8e36-4a64-a1c6-47a4483587a3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.351446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.367623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.368643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.369073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.369464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.379241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.380532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 437/861] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:30.386555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:30.402216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:30.403259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:30.404228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 425/862] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:30.409799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.510898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ff1b2-025e-4329-8a87-b9450be83cfc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.512341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.540052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.548049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.549677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.550337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.550912 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.551878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:30.552475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.554219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.573122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 438/863] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:30.578390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.662833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4af58a-897f-4c44-b213-024c2f2124ef None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.698010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cc5d40-8839-4fdd-a6dc-a078860355e2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.699923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.700763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.701104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.701451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.702129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.703538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:30.713169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:30.714363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:30.715269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 426/864] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:30.716075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.739089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.739812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.740139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.740414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.768753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.771048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:30.810316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.811753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.826352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e4d791-ce3e-4cf2-bf56-f871c6aed6ff None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:30.861241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:30.861846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:30.862154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:30.862424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:30.863068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:30.864408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:30.879891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 427/865] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:30 2022] POST /identity/v3/services => generated 251 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:30.880929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:30.934879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 439/866] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 01:41:30.940320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.010757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.018238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf29d3-e860-4234-b5b6-2d39faab2128 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.021319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.060498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e591b9-c282-4701-b8dc-0ac7795dbd35 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.063066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.063916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.064196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.064466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.065094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:31.065402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.066838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.072042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 428/867] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:31.077359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.099939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.100576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.100863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.101143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.113056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.114536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:31.130218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:31.131211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:31.132125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:31.132125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:31.132125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:31.132125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 440/868] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:31.137402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.209711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be6983-a558-4062-891c-836f2b1858e5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.246797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.247571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.248254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.248383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.249159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:31.249534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.251597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.255905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1780da-48e8-443f-8be1-5dda3f9acebd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.257035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 429/869] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:31.273011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.296469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.297593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.298157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.298632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.299501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:31.300009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.301597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.316236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 441/870] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:31.324685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.358491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.440436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44155414-8f73-432c-85c8-000a6feb3d8c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.479024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.479581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.479865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.480141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.487649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.489090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:31.500496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:31.501413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:31.502748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:31.506007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 430/871] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:31.508481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.615816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacedf4f-d014-4b9e-b691-f522c94552e5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.652875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.653915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.654421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.654901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.655792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:31.656413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.658062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15bb92-1e3a-49c4-876d-6b68d0084809 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.670500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 442/872] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:31.676878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:31.726350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761f46-84d2-41d1-a6d1-8956408be69b None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.726687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761f46-84d2-41d1-a6d1-8956408be69b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.726937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12761f46-84d2-41d1-a6d1-8956408be69b None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.729083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 443/873] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:31.735020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.735305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.735605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.753946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:31.755204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:31.783471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.803656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566bf46-52c3-4bdf-8ee4-7bba6d423446 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:31.822232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:31.836154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 444/874] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:31.855416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:31.856381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:31.857100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:31.857806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:31.859385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=1a82594a77b542e5be1ea542cbfdf70b) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:31.860251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:31.862737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:31.870399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 431/875] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:31 2022] GET /identity/v3/role_assignments?user.id=1a82594a77b542e5be1ea542cbfdf70b&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:32.112685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:32.219631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f55fbd-de2c-455b-839f-c271cf7ac71d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:32.255021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:32.256034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:32.256521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:32.257006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:32.257808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:32.259345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:32.269425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:32.270734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:32.271835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:32.274192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 445/876] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:32.282000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:32.385768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11aff0d-8985-4b62-b655-75458fc48be0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:32.420952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:32.422337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:32.422774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:32.423206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:32.423972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:32.424422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:32.426011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9c5ed-f8b9-4a8d-842c-09eb0ada3b86 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:32.430966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 432/877] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:32.437033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:32.465290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:32.543478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac96d26-f642-4496-88e7-5735559d8a5f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:32.578017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:32.578887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:32.579343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:32.579768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:32.580547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:32.580998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:32.582518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417d46e-7be9-48ae-959b-418910452802 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:32.587559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 446/878] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:33.174257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903881-0878-42fb-9e3d-c42be8bae48a None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.174776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903881-0878-42fb-9e3d-c42be8bae48a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.174776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86903881-0878-42fb-9e3d-c42be8bae48a None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.176372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 433/879] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:33.181532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c09f5-a046-45f5-99a0-6a9c4e1b51f8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.181980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c09f5-a046-45f5-99a0-6a9c4e1b51f8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.182308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c09f5-a046-45f5-99a0-6a9c4e1b51f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.200670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c82c09f5-a046-45f5-99a0-6a9c4e1b51f8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:33.201845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c82c09f5-a046-45f5-99a0-6a9c4e1b51f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:33.272530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 447/880] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:33.515735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90a4-63e7-431f-af35-93fdb8fbca96 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.516304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90a4-63e7-431f-af35-93fdb8fbca96 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.516783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f90a4-63e7-431f-af35-93fdb8fbca96 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.518551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 434/881] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:33.524093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.524386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.524721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.540251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f90a4-63e7-431f-af35-93fdb8fbca96 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:33.544227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:33.545403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:33.559907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:33.564781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:33.633398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 448/882] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:33 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:33.657666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f90a4-63e7-431f-af35-93fdb8fbca96 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:33.694280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:33.694848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.695181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.695455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.696107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:33.697676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:33.707783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:33.708805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:33.709670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 435/883] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:33.716900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:33.826059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290c214-0f48-4cd2-a7aa-ae3a17c4b0cd None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:33.862006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:33.863021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:33.863530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:33.864030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:33.864870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:33.865376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:33.866985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:33.872197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 449/884] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:33.878070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:33.930610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:33.947934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:33.971484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:33.990177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20b60f-9636-49ac-9e34-23ea3ac2bd47 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.027217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.027909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.028127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.028356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.028982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:34.029283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:34.030674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:34.041132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 436/885] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:34.041355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af2eca-1f09-4b3e-8a66-2e6f60c8adfc None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.042570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:34.079927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.080926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.081426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.081982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.082908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:34.084491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3091691-8ab4-4c55-a827-fd2c9598a0cf None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:34.109899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 450/886] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:33 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:34.170314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69d4d0-ad9a-4249-a3af-12c502799d0b None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.170905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69d4d0-ad9a-4249-a3af-12c502799d0b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.171182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd69d4d0-ad9a-4249-a3af-12c502799d0b None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.173887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 451/887] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:34.179686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.179959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.180317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.183768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b6296-4512-4273-8329-8ab8715b0254 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.203984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:34.205527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:34.240144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.241074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.241354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.241626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.242540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] RBAC: Adding query filter params (interface=public, service_id=3857d566fe2c48eb8e0975cbe0f14dc6, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:34.242851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:34.244940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:34.252689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 437/888] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:34 2022] GET /identity/v3/endpoints?service_id=3857d566fe2c48eb8e0975cbe0f14dc6&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:34.258334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:34.292890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:34.298568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 452/889] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:34.386496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91473e5e-dbd1-4764-9cd3-98ee80343efe None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.421639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.422870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.423118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.423385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.423984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:34.425400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:34.431506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 438/890] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:34 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:41:34.566484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:34.569924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:34.678286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1c59ff-04bf-4818-8392-253113cf2af6 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.715060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.715744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.716025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.716295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.727060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f7cbdc1d-8ad1-478f-98d7-bc2724975cab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:34.731826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:34.732769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:34.733619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 453/891] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:41:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:34.739744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:34.783195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54288c-6e00-4c6a-9e52-e7d22d34e385 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.783518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54288c-6e00-4c6a-9e52-e7d22d34e385 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.783767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54288c-6e00-4c6a-9e52-e7d22d34e385 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.785932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 454/892] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:34.793197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.793531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.793757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.814521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:34.815737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:34.820289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:34.859937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca8fa2-a725-476b-8db3-e60a4c7e4b9f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:34.891886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:34.898310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:34.898917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:34.899199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:34.899474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:34.900395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:34.900509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:34.901808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:34.906903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 455/893] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:34.918349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 439/894] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:41:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:34.919556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.024165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347c8ab-9e16-4b9b-801c-47e53d58682d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.064966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.064966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.064966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.064966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.073551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.075092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:35.090199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:35.091164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:35.092092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:35.092092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:35.092092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:35.092092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 456/895] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:35.098961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.185903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.226078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4076a-fc39-4941-bc33-54382d47a7f1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.231035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:35.268038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.268737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.269025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.269298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.269970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:35.270282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.271767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.273853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:35.286715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 440/896] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:35.291923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.304982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4765454e-1513-4c74-9931-dc4762ffe518 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.346415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.348182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.348969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.349441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.350465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.352209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.371895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 457/897] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:35 2022] POST /identity/v3/services => generated 241 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:35.405149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fa91af-4f92-4ce3-833c-3384dd2a8399 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.450999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.451700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.451983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.452254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.461808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.463429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:35.477353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:35.478465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:35.479458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 441/898] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:35.485227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.595022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06808808-bf47-48b9-9bf5-5288c0fe7ea6 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.603051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:35.633973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.634593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.634874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.635249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.635993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:35.636303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.637726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.656631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 458/899] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:35.662059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:35.718205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:35.771126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47713c9-02d7-4f9f-94c8-734651bf5d51 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:35.805892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:35.806874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:35.807371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:35.807848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:35.876724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:35.878534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:35.927221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:35.986777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 442/900] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:35.992377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:36.093020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8312be-dc98-4dc6-a442-0f0575615733 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:36.128467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:36.129028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.129309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.129583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.140183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:36.141805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:36.157068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:36.158326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:36.159253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:36.159253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:36.159253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:36.159253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 459/901] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:36.164156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:36.278462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e3b05-171b-41be-af4c-a1d743aab81a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:36.314342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:36.314956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.315233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.315505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.316145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:36.316446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:36.317811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:36.330496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 443/902] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:36.335544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:36.357936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:36.444537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54451ed-b5c9-4177-9eef-68874458580f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:36.479697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:36.480354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.480688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.480968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.488979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:36.490481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-54f32419-83de-429c-ae0a-30891229ebf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:36.503884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:36.504890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:36.505798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 460/903] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:36.515384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:36.530612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:36.614949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e613-ca61-4d11-a554-b38617071a2a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.615237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e613-ca61-4d11-a554-b38617071a2a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.615789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee24e613-ca61-4d11-a554-b38617071a2a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.617531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 461/904] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:36.623512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979c34-fa21-41ce-881d-c50dd300b07a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.623919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979c34-fa21-41ce-881d-c50dd300b07a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.624291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99979c34-fa21-41ce-881d-c50dd300b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.642865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7c333-7db0-42b9-ab12-5c1a83ec06a5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:36.645988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-99979c34-fa21-41ce-881d-c50dd300b07a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:36.647177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-99979c34-fa21-41ce-881d-c50dd300b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:36.678672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:36.679285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.679567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.679841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.680519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:36.680831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:36.682280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5163ad82-6f75-427d-93ac-788b0d7bc3ec None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:36.700361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 444/905] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:36.700361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fa5c-7421-4c8c-8bc3-fbcdec283c2b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.700361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fa5c-7421-4c8c-8bc3-fbcdec283c2b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.700361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5fa5c-7421-4c8c-8bc3-fbcdec283c2b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.700361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 445/906] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:36.702222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5fa5c-7421-4c8c-8bc3-fbcdec283c2b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:36.725774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 462/907] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:36.726977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.727268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.727541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.740005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:36.747552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:36.748870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:36.791839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:36.831523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5fa5c-7421-4c8c-8bc3-fbcdec283c2b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:36.833989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 463/908] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:36.871749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:36.872735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:36.873211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:36.873758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:36.874865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] RBAC: Adding query filter params (role.id=51637f7de2fe4fe8aeb6a446f580c4a8, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=1a82594a77b542e5be1ea542cbfdf70b) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:36.875385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:36.877074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:36.883037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 446/909] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:36 2022] GET /identity/v3/role_assignments?user.id=1a82594a77b542e5be1ea542cbfdf70b&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=51637f7de2fe4fe8aeb6a446f580c4a8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:37.022398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.112631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.128833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0be62-9495-4b80-814c-69d2369face0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.165533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.166537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.167054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.167540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.168194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.169632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.172765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:37.180046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:37.181230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:37.182314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:37.183888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 464/910] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:37.190806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.243294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1f69-29c1-4fbb-8a14-ca7faffd59c1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.288978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.290004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.290364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.290714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.291541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.293653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.296012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:37.306910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:37.307974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:37.308854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 447/911] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:37.316674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.319750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c31081-b1b4-48d0-8ca0-a997a88eacb8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.359675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.361049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.361623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.362116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.362934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:37.363443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.365081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.371544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 465/912] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:37.382052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.439702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320772f-eb5d-4964-bf59-95f951dd9f14 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.458623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.477592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.478458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.478886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.479305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.480076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:37.480567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.482134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.492424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 448/913] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:37.493897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.503676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f453b2-26f7-4ebc-97d1-c195c9a1c120 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.544769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.545290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.545528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.545802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.546514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:37.547355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.549344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.557935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 466/914] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:37.562819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.566605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.609848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e1a52-53fc-4a0b-b7c2-d6290f0c7141 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.653092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.653967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.654320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.654680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.655442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:37.655873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.657631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.668614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 449/915] 10.222.0.33 () {56 vars in 1114 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:37.670085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.706700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60e8ef-8fc0-407b-9091-b9f5f124c1d8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.743767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.755711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.757072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.757517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.757968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.759242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] RBAC: Adding query filter params (interface=public, service_id=5428b995726145a796342e4ae6854706, region_id=RegionOne) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:37.759844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.761727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220ba177-9304-456f-86df-d19bd1be0384 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.768839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 467/916] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/endpoints?service_id=5428b995726145a796342e4ae6854706&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:37.770645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae01a-5ca2-4423-952f-ade7643754fa None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.770938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae01a-5ca2-4423-952f-ade7643754fa None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.771217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae01a-5ca2-4423-952f-ade7643754fa None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.773184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 468/917] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:37.779864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.780189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.780692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.784717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cb9ed-506e-474f-a1b0-aaf5389ea49c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:37.802430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:37.803542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:37.812513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:37.822189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:37.822800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:37.823080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:37.823354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:37.824276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:37.825477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:37.851968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 450/918] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:37.853189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:37.886365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 469/919] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:37.981048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eec6d2-da8c-4fd6-b1e1-9211d2e0ecf2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.020965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.021970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.022474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.022919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.023755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.025348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.033387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 451/920] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:37 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:41:38.155682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:38.267636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c1c54-739a-4922-bbc9-ced2513ce1b9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.287297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:38.305253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.305909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.306356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.306696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.307514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.308879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:38.317710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:38.318709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:38.319539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 470/921] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:38.326609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:38.376893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:38.435203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a051d8ae-dcc9-4c6f-92f1-cc5fc1777552 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.470945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.471929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.472415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.472883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.473712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:38.474252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.475821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.481330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 452/922] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:38.487635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:38.589440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ab759-b78a-4178-a9ab-60663780885f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.623406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.624499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.625518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.626015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.626907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:38.627407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.628985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.634420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 471/923] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:38.640947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:38.746980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328c8c8-fd11-4263-b391-98f91f74aa0e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.758911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:38.784674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.785655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.786163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.786668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.787555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] RBAC: Adding query filter params (interface=public, service_id=5b4409f8ae624c93b2f65ee83b17be18, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:38.788072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.789622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065122e-eabe-4caf-b031-bf2c0abf1885 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.795317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 453/924] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:38 2022] GET /identity/v3/endpoints?service_id=5b4409f8ae624c93b2f65ee83b17be18&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:38.801807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:38.853504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:38.907806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee35515-672f-4e87-babe-5d5d25466a6d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:38.942481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:38.943091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:38.943374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:38.943651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:38.944253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:38.945612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121085e-5578-48b2-9bc1-90cf747b4aea None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:38.952007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 472/925] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:38 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:41:39.116848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac17dd-967d-4fb0-ae35-1190db23b596 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:39.117151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac17dd-967d-4fb0-ae35-1190db23b596 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:39.117331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfac17dd-967d-4fb0-ae35-1190db23b596 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:39.118963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 454/926] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:39.124666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:39.125008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:39.125264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:39.147444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:39.148632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:39.227501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 473/927] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:39.495605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac17dd-967d-4fb0-ae35-1190db23b596 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:39.606079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfac17dd-967d-4fb0-ae35-1190db23b596 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:39.641524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:39.642235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:39.642524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:39.642846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:39.654635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:39.659657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:39.660585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:39.661432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 455/928] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:41:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:39.666772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:39.717161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:39.778944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917f8e02-8ec0-4489-b0e4-5eeee1c29b5f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:39.814169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:39.814781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:39.815062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:39.815335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:39.815995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:39.816298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:39.817728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:39.826621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 474/929] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:41:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:39.834948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:39.870543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:39.948552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102da6-15dd-4a8e-a994-12a20fc427b3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:39.985111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:39.985744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:39.986055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:39.986330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:39.997356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:39.998832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:40.013323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:40.014600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:40.015621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:40.015621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:40.015621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:40.015621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 456/930] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:40.022958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.131519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ae60-0771-4fae-a4a1-624b1aefba69 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.132939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.172863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.173830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.174208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.174490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.175212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:40.175856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.177497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5bdb-c91b-4a38-8e12-692cad0ddfbe None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.190784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 475/931] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:40.196552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.200193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087480c5-a507-4b14-8797-6d84cc485b41 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.200193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087480c5-a507-4b14-8797-6d84cc485b41 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.200193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087480c5-a507-4b14-8797-6d84cc485b41 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.201507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 476/932] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:40.206743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c67de-933b-4c40-b274-1a739bc56811 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.207252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c67de-933b-4c40-b274-1a739bc56811 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.207800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c67de-933b-4c40-b274-1a739bc56811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.227982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3c6c67de-933b-4c40-b274-1a739bc56811 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:40.229237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3c6c67de-933b-4c40-b274-1a739bc56811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:40.312649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 477/933] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:40.321900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.340171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97edb9fd-3c96-486f-b287-70994bda8f77 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.370286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde0c6-56c3-4f62-81bd-5821bee4cfe1 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.370661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde0c6-56c3-4f62-81bd-5821bee4cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.370940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edde0c6-56c3-4f62-81bd-5821bee4cfe1 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.372670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 478/934] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:40.378388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.378775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.379150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.379673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.380473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.380898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.381317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.390053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.392198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.400892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:40.402268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:40.404032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:40.405143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:40.406454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:40.408250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 457/935] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:40.415431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.509910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 479/936] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:40.533252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a28cb8-780c-4250-9654-25447a052c3f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.570010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.570615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.570897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.571172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.571887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:40.572249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.573722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.592011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 458/937] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:40.594606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.599090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.603023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.621495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.709304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23a354-6890-4763-8897-b13a9bb5b38b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.737748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a1fbd-3de9-4cde-b5bc-ca5f9d734dac None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.748136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.749012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.749974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.750429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.751499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.753855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.757626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING keystone.server.flask.common [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 16 01:41:40.774445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.775164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.775507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.775849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.782366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.sql.core [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 01:41:40.782366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 01:41:40.782366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [parameters: {'id': '2f627b4f4a7941e9b245450bb3f5b8dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 01:41:40.782366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81453) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 01:41:40.787426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.789008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f627b4f4a7941e9b245450bb3f5b8dc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f627b4f4a7941e9b245450bb3f5b8dc. Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:41:40.804814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result.read() Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 16 01:41:40.805715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application yield resource Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise self.value Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application session.commit() Sep 16 01:41:40.812489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.session.flush() Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application compat.raise_( Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 01:41:40.813409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 01:41:40.814347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result.read() Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:41:40.815162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [parameters: {'id': '2f627b4f4a7941e9b245450bb3f5b8dc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.816085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.816889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2f627b4f4a7941e9b245450bb3f5b8dc. Sep 16 01:41:40.817807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:40.820236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:40.821556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:40.823401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:40.823401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:40.823401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:40.823738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 480/938] 10.222.0.33 () {60 vars in 1140 bytes} [Fri Sep 16 01:41:40 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:40.823866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 459/939] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:40.824007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.824142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.880062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.898432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:40.923056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e0809-6a04-472a-b0da-c7dd2b79f9ac None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.927562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee02670-157c-4833-8f48-bb58ae17c475 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:40.958557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.959188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.959524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.959743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.960325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.962014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.965012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:40.965705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:40.966016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:40.966289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.971370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:40.972334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 16 01:41:40.973222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:40.975393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:40.976825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:40.977369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 481/940] 10.222.0.33 () {56 vars in 1132 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:40.978119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:40.988515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:40.989410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:40.990407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 460/941] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:40.992282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.087085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990fe65-a229-404c-9ec8-b2e0351f92b5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.095541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da747c8-c645-470f-b91f-5a6c3f159dcd None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.112057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.123368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.124273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.124273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.125093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.125743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:41.126113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.127474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.133740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.134403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.134694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.134978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.135656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:41.136033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.137488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.143247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 461/942] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:41.144113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.144626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 482/943] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:41.149199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.155733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.260219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9370503-650f-453f-97cf-bf566aeee093 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.275971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a24a5-c3c9-4383-b681-3f161952ba25 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.295468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.296078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.296368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.297219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.297908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:41.298215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.299640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.310644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.311257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.311540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.311838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.313048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:41.313349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.315174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad921102-08c7-4c39-8091-4575e262b6fd None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.317239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 462/944] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:41.318066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.324659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 483/945] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:41.324659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5e9e-f796-46a9-aeb0-b3fe3454e7f1 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.324659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5e9e-f796-46a9-aeb0-b3fe3454e7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.324659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa5e9e-f796-46a9-aeb0-b3fe3454e7f1 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.324659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 484/946] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:41.333649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5e9e-f796-46a9-aeb0-b3fe3454e7f1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.365117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.410651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.434388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831669e-7ad9-4d08-94f5-6d503b98d03b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.451173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa5e9e-f796-46a9-aeb0-b3fe3454e7f1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.472293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.472950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.473231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.473504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.481097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.482641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.489428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.490049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.490337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.490612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.491287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.492640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-29f1b70d-ef64-4abb-9313-29eb0e15bfc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:41.497255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:41.498206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:41.499114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 463/947] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:41.499709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.499889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.500228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.521099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 485/948] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:41 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:41.521696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.526704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:41.528268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:41.636370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 464/949] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:41.657781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4319e96-641b-48e4-965f-228b58ea0f9f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.685184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.698224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.698850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.699817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.700144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.700844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:41.701198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.702800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.715495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 486/950] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:41.721768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:41.754560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:41.834446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad79c4-519d-4f22-a8de-c379edb57c75 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:41.870267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:41.871253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:41.871715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:41.872157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/1a82594a77b542e5be1ea542cbfdf70b/roles/51637f7de2fe4fe8aeb6a446f580c4a8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:41.874488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=1a82594a77b542e5be1ea542cbfdf70b, role_id=51637f7de2fe4fe8aeb6a446f580c4a8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:41.876628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:41.893815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 465/951] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:41:41 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/1a82594a77b542e5be1ea542cbfdf70b/roles/51637f7de2fe4fe8aeb6a446f580c4a8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:41:41.918215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:42.033159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9dd85-19f0-49d7-8f3b-d76bbfff9944 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:42.070355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:42.071333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:42.071802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:42.072249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:42.073009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:42.074691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:42.085039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:42.086079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:42.087087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:42.089537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 487/952] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:42.096329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:42.187570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:42.202572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c039-4ce2-4926-8950-e3846e27c35d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:42.239921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:42.240544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:42.240824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:42.241100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:42.241728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:42.242051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:42.243405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:42.248784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 466/953] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:42.255197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:42.308012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:42.370585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b174e306-5cbb-4b6a-9f41-31250dc15c98 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:42.405534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:42.406694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:42.406977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:42.407251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:42.407953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:42.408257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:42.409741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b6d45-5a39-46d7-bda9-13c034e7b451 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:42.414985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 488/954] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:42.420610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:42.528859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a1edc-391f-4a22-a1fb-4f9357629b2e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:42.564483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:42.565195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:42.565478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:42.565749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:42.566499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:42.567871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b429656a-3995-4105-82a7-d447f8fda56c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:42.589343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 467/955] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:43.623370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776e24-5e0b-4f84-b1dd-6c0d8c589d5a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:43.624223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776e24-5e0b-4f84-b1dd-6c0d8c589d5a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:43.624725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66776e24-5e0b-4f84-b1dd-6c0d8c589d5a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:43.626489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 489/956] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:43.631981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a4e5-3068-4acb-8037-d0fefebe0a27 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:43.632782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a4e5-3068-4acb-8037-d0fefebe0a27 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:43.633264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9a4e5-3068-4acb-8037-d0fefebe0a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:43.650568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:43.657488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9cb9a4e5-3068-4acb-8037-d0fefebe0a27 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:43.659548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9cb9a4e5-3068-4acb-8037-d0fefebe0a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:43.742815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 468/957] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:43.813127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433414-96db-4d26-9c52-2739d4800037 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:43.813426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433414-96db-4d26-9c52-2739d4800037 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:43.813850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1433414-96db-4d26-9c52-2739d4800037 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:43.815543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 490/958] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:43.820827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:43.821116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:43.821391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:43.840340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:43.841526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:43.910211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 469/959] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:44.009388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1433414-96db-4d26-9c52-2739d4800037 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.118401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1433414-96db-4d26-9c52-2739d4800037 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.130419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.154476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.155090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.155374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.155657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.156342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.157769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.178566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.sql.core [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 01:41:44.178566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 01:41:44.178566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [parameters: {'user_id': 'e57993a5cb8f4aa094fee3b5298460cc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 01:41:44.178566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81453) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 16 01:41:44.183863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result.read() Sep 16 01:41:44.185085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:41:44.186086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application yield resource Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application next(self.gen) Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.session.rollback() Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.force_reraise() Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise self.value Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application session.commit() Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 16 01:41:44.188281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._prepare_impl() Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.session.flush() Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._flush(objects) Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application compat.raise_( Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application flush_context.execute() Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rec.execute(self) Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 16 01:41:44.189206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 16 01:41:44.190184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result = self._query(query) Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application conn.query(q) Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application result.read() Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 16 01:41:44.191054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e57993a5cb8f4aa094fee3b5298460cc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:44.194521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 16 01:41:44.195373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 491/960] 10.222.0.33 () {60 vars in 1131 bytes} [Fri Sep 16 01:41:44 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:44.196283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.264288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.305590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40afae67-f086-4dc3-a0cc-e7c6e69c3643 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.317425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcc31f-499f-4e8e-8478-5fa899b4b196 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.346561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.347295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.347576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.347852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.348434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.349805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.353950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.354758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.355236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.355654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-8b12f153-942d-430c-8896-8518debfbd01 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:44.358736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:44.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:44.361318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 470/961] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:44.362162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f9ba-dc62-41a2-bd3d-80ec1fe00af0 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.362162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f9ba-dc62-41a2-bd3d-80ec1fe00af0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.362368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c56f9ba-dc62-41a2-bd3d-80ec1fe00af0 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.363723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 471/962] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:44.366245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f9ba-dc62-41a2-bd3d-80ec1fe00af0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.371424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.373092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b60e9d80-d65a-4428-8d10-2847f8414564 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:44.385614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:44.386832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.388011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 492/963] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:44.393456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.393750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.394059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.413433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:44.414995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:44.441913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.485156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c56f9ba-dc62-41a2-bd3d-80ec1fe00af0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.492408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 493/964] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:44.493407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.528119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.540452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.541078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.542244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.542529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.543160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:44.543461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.544834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.554018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 472/965] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:44.556883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.635276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef20e5-5341-42f4-a745-c0b01c693ebb None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.676194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.677049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.677645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.678112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.679009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:44.679464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.681844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.689390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99010f86-ab89-4e65-a069-882b72e15b35 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.727879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 494/966] 10.222.0.33 () {56 vars in 1101 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:44.731401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.732036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.732314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.732587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.733234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:44.733539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:44.740569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9172fb-9e44-4b36-9165-06976a8d9e32 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:44.746015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 473/967] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:44.782462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:44.809169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.830019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cbc9-47fd-44cd-b058-87690680e740 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.830532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cbc9-47fd-44cd-b058-87690680e740 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.831032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f197cbc9-47fd-44cd-b058-87690680e740 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.833061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 474/968] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:44.839327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.839606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.839880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.860739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:44.862435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:44.915762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecf0b3f-5cfa-4065-ad4e-4e5e790db791 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:44.933985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:44.965831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 475/969] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:44.971399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:44.971955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:44.972238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:44.972512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:44.986762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:44.990918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:44.992020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:44.993022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 495/970] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:44.998115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.110770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fbdd86-07cb-4cd0-a7d3-af52fae559b2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.145728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.146372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.146658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.146934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.147600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.147908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.149272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.157898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 476/971] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:41:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:45.163469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.244594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.245130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.276643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de4d36-5674-4789-a153-092ac03b50d7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.296027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.322797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.323424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.323704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.323975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.334850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.336312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:45.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:45.354729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:45.355632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:45.355632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:45.355632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:45.355632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 496/972] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:45.362291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.363627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f6309-5684-4c07-9d84-d64707b0e598 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.400671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.401298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.401576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.401847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.402457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.403805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:45.416611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:45.417626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:45.418522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 477/973] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:45.424918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.469416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe15911-b7b5-4c72-8b00-99beaa6d2ab2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.501104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.507270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.507880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.508155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.508424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.509063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.509363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.510737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.523429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 497/974] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:45.528827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.530101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366cd4e-8806-472b-aabe-335996a0d71b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.543667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.568418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.569137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.569491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.569833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.570580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.570954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.572459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.582919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 478/975] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:45.584754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.643436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae404a-9393-45fd-ab68-c1255ce29484 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.680746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.681625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.682085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.682498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.691314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.693642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.694600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcebe338-447c-449c-b1ce-29dfe478164e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:45.708645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:45.709960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:45.711117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 498/976] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:45.716776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.733301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.734597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.734972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.735307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.735992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.736381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.737819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.742770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 479/977] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:45.748216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.776151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.789391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:45.828402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabcb2f1-7c32-494e-a2fa-2c270dee8120 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.854368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59211d19-58fd-4709-b5ca-d80f785d02e3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:45.865306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.866418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.866876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.867310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.868173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.868487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.869967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.887759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:45.888366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:45.888647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:45.889175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:45.889622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 499/978] 10.222.0.33 () {56 vars in 1149 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:45.891301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] RBAC: Adding query filter params (interface=admin, service_id=5b4409f8ae624c93b2f65ee83b17be18, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:45.891698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:45.893936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:45.895844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:45.908565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 480/979] 10.222.0.33 () {56 vars in 1249 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/endpoints?service_id=5b4409f8ae624c93b2f65ee83b17be18&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:45.909552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.011561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b825e-d086-42f5-8c71-2ae598c856e3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.017166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f31a74-9b5d-4cd6-a43f-35a26cafdda5 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.018867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:46.024298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:46.053199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.053738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.054064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.054345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.055699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.056428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.056810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.057250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.058688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.060094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.070026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 481/980] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:41:46.130185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.131856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.240721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 500/981] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:45 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 01:41:46.245341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.352103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59dd5c-33cc-4b10-b4a7-5ab5a3f11577 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.386657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.387296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.387580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.387859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.398961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.400416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:46.414754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:46.415705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:46.416600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:46.416600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:46.416600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:46.417379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 482/982] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:46.422046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.433566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:46.522744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d77a72a-17d9-49e6-87ed-9480f7cecbc7 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.558734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.559406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.559689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.559963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.560662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:46.560972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.562951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.578061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 501/983] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:46.580236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.600159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:46.684685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bbe73-2d21-4e1f-8d0c-5084ab20595c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.718480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.719848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.720316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.720771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.727730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.729383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:46.741290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:46.742246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:46.743162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:46.743607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 483/984] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:46.750107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.823622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:46.857361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f9754-eca6-49af-b2fb-c515d44471d5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:46.896280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:46.896893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.897174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.897449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.898170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:46.898480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:46.899903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae17797-f163-44f0-809c-6c44705eb049 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:46.912651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 502/985] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:46.918536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:46.981316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a41df-1275-4e4c-a02b-56a5df044cd8 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.981515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a41df-1275-4e4c-a02b-56a5df044cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.981791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a41df-1275-4e4c-a02b-56a5df044cd8 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:46.983309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 503/986] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:46.988406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc61d-889f-40c6-861e-27bbb2b7fafd None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:46.988698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc61d-889f-40c6-861e-27bbb2b7fafd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:46.988975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3dc61d-889f-40c6-861e-27bbb2b7fafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:47.007149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:47.008846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1d3dc61d-889f-40c6-861e-27bbb2b7fafd None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:47.010122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1d3dc61d-889f-40c6-861e-27bbb2b7fafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:47.033114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39f2af-1a6b-4a75-aa1f-98c4913cdf4a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:47.068031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:47.068632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:47.068913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:47.069184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:47.069921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] RBAC: Adding query filter params (role.id=51637f7de2fe4fe8aeb6a446f580c4a8, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=1a82594a77b542e5be1ea542cbfdf70b) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:47.070259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:47.071653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:47.078111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 484/987] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:46 2022] GET /identity/v3/role_assignments?user.id=1a82594a77b542e5be1ea542cbfdf70b&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=51637f7de2fe4fe8aeb6a446f580c4a8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:47.080918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 504/988] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:47.351321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:47.456021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537413-5a03-49e0-b4ad-b300789abf44 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:47.489679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:47.490316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:47.490596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:47.490871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:47.491530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:47.492888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351dffa-75f5-4e57-9286-bd49fe088141 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:47.510196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 485/989] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:47 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:48.276911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7daa-5751-466d-b83e-783d903c01b8 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:48.277357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7daa-5751-466d-b83e-783d903c01b8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:48.277532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c7daa-5751-466d-b83e-783d903c01b8 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:48.278882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 505/990] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:48.284628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:48.285013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:48.285180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:48.291474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:48.306165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:48.307370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:48.385910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 486/991] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:48.647759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7daa-5751-466d-b83e-783d903c01b8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:48.707124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:48.752481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c7daa-5751-466d-b83e-783d903c01b8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:48.789300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:48.789962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:48.790248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:48.790522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:48.791110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:48.792473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:48.801293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:48.802312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:48.803184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 506/992] 10.222.0.33 () {56 vars in 1126 bytes} [Fri Sep 16 01:41:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:48.811129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:48.912455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c74b6-dd52-42cc-86b8-578efd36c1d5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:48.938273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:48.948141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:48.948756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:48.949091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:48.949368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:48.950023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:48.950331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:48.951688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:48.957094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 487/993] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:48.962737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:49.061735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45677d8-0eb0-41eb-ac08-56a097d182e5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:49.084285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:49.096588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:49.097200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.097481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.097757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.098417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:49.098721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:49.100069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0dd87-1819-4830-9d47-aaa139dc1427 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:49.110067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 507/994] 10.222.0.33 () {56 vars in 1122 bytes} [Fri Sep 16 01:41:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:49.111316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:49.220644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe357ae-0dca-4732-8ecb-1bde9535b9ea None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:49.254867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:49.255483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.255770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.256047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.256728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:49.261218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:49.273769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61236067-b751-49b6-a042-dfaf2868c583 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.274115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61236067-b751-49b6-a042-dfaf2868c583 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.274358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61236067-b751-49b6-a042-dfaf2868c583 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.275916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 508/995] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:49.282061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521707-9aee-472e-9547-c08043ad8062 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.282596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521707-9aee-472e-9547-c08043ad8062 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.282596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab521707-9aee-472e-9547-c08043ad8062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.290183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 488/996] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:49.306812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ab521707-9aee-472e-9547-c08043ad8062 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:49.308050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ab521707-9aee-472e-9547-c08043ad8062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:49.391059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 509/997] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:49.657916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:49.697114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eea4a-e975-4153-9d0e-0088357f4df4 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.697441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eea4a-e975-4153-9d0e-0088357f4df4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.697685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25eea4a-e975-4153-9d0e-0088357f4df4 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.699220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 510/998] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:49.704854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.705211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.705566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.712887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:49.725266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:49.726490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:49.767576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d663179-07e7-4e41-8a44-e8729fa250e9 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:49.806555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:49.806555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.806555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.806555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] PATH_INFO: `/v3/services/image` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.806997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:49.806997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:49.810150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 511/999] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:49.818331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:49.822214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:49.823096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 489/1000] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 01:41:49 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:49.826101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:49.872644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:49.927254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59fefb7-804f-49ef-8c46-9f8f3ff6f506 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:49.961116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:49.961729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:49.962040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:49.962317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:49.962941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] RBAC: Adding query filter params (name=image) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:49.963247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:49.964600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:49.974728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 512/1001] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:49.975939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.075914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.082977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac6f31-db25-4a3f-858f-b98ba15eef83 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.102409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:50.121579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.122274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.122508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.122787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.123419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] RBAC: Adding query filter params (type=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:50.123726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.125634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.130526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 490/1002] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:49 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:50.191555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dee2e-0eca-4b86-b4ae-84cefe7c98b1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.202336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:50.229114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.229767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.230079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.230357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] PATH_INFO: `/v3/services/compute` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.230955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.232331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:50.242296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:50.243399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:50.244265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 513/1003] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:50 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:50.252561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.369155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bf1160-c931-4fe1-8338-db52928f3f83 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.404142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.404750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.405027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.405293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.405934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:50.406237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.407595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.417254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 491/1004] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:50 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:50.418528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.521393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389aeab-e4e8-4fac-b2c9-01e4f50d44ff None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.555493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.556108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.556391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.556665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.557472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:50.557783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.559459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.572438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 514/1005] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:50 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:50.573426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.621029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:50.677744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ac878-e17a-4f3c-825d-ac567872c5ca None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.711883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.712494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.712766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.713035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.713722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] RBAC: Adding query filter params (interface=public, service_id=e6f6b69f43d74614afe4f09d30a036d2, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:50.714058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.715407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5e7f8-6997-40c5-976a-f9f5f5cde560 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.725154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 492/1006] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:50 2022] GET /identity/v3/endpoints?service_id=e6f6b69f43d74614afe4f09d30a036d2&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:50.726376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:50.763193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:50.833394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27444ae3-b1c3-4ac7-8f95-fb6cb43f8896 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:50.867291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:50.867936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:50.868226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:50.868497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:50.869093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:50.870632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e4216-34b0-46d1-95f4-ad687b822e98 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:50.878016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 515/1007] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:50 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:41:51.472929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a16-19df-40ff-aed0-64eb08990bb8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:51.473472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a16-19df-40ff-aed0-64eb08990bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:51.473472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c76a16-19df-40ff-aed0-64eb08990bb8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:51.474975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 493/1008] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:51.480089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:51.480467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:51.480644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:51.498823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:51.500537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:51.566867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 516/1009] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:51.837828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76a16-19df-40ff-aed0-64eb08990bb8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:51.944030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c76a16-19df-40ff-aed0-64eb08990bb8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:51.954983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:51.980878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:51.981508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:51.981785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:51.982096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:51.983253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:51.984724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8dffb3-fc42-4750-af84-c8cda352acdb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:51.991088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 494/1010] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:51.992418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:52.023599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:52.099006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054e2c3-59ab-4de5-b562-a629d97bbe1d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:52.135904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:52.136871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:52.137361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:52.137850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:52.138773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:52.141271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70f8f4-b918-491b-8c33-654c87dff909 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:52.169711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 517/1011] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:51 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:52.326527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4be1-c4e1-4ade-a916-b2e81b086260 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:52.326882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4be1-c4e1-4ade-a916-b2e81b086260 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:52.327097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a4be1-c4e1-4ade-a916-b2e81b086260 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:52.328737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 495/1012] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:52.334184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9545-3305-4df6-bc35-3133b9977053 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:52.334482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9545-3305-4df6-bc35-3133b9977053 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:52.334766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b9545-3305-4df6-bc35-3133b9977053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:52.353575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-220b9545-3305-4df6-bc35-3133b9977053 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:52.354735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-220b9545-3305-4df6-bc35-3133b9977053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:52.433401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 518/1013] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:52.698054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a4be1-c4e1-4ade-a916-b2e81b086260 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:52.802848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a4be1-c4e1-4ade-a916-b2e81b086260 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:52.838067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:52.838679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:52.838960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:52.839232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:52.839891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:52.841254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7a025-bb50-4998-8990-8aee7ec82eb7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:52.856662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 496/1014] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:41:52 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:53.081427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4c07-d129-4835-8282-92b9dd0a5ebf None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:53.081991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4c07-d129-4835-8282-92b9dd0a5ebf None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:53.081991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4c07-d129-4835-8282-92b9dd0a5ebf None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:53.083486 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 519/1015] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:53.088604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:53.088887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:53.089159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:53.108948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:53.110172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:53.140841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:53.187980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 497/1016] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:53 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:53.451474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4c07-d129-4835-8282-92b9dd0a5ebf None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:53.467173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:53.557103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4c07-d129-4835-8282-92b9dd0a5ebf None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:53.591599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:53.592231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:53.592509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:53.592778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:53.593435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:53.594833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:53.603562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:53.604546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 16 01:41:53.605402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:53.609607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 520/1017] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:53 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:53.610773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:53.713818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be4d77-9c43-496f-921a-8ade7892eae1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:53.747420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:53.748033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:53.748317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:53.748588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:53.749755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:53.750089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:53.751470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:53.761692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 498/1018] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:53.763132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:53.840347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:53.864047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aea4d3-3d01-4a5c-ba22-ec32f5d123dc None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:53.897476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:53.898107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:53.898391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:53.898665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:53.899284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:53.899590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:53.900950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e5bef2-6fa1-468b-9a6c-99954f0916fa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:53.910427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 521/1019] 10.222.0.33 () {56 vars in 1112 bytes} [Fri Sep 16 01:41:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:53.911530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:53.939586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:54.012850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aaf77a-a466-4960-a807-de3a98398ae1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:54.047890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:54.048501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:54.048781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:54.049055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:54.049721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:54.051111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b2280-005b-4d79-83d5-84ed8e18869c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:54.070621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 499/1020] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:53 2022] POST /identity/v3/endpoints => generated 334 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:41:54.406699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362a3b-a60e-4572-b7db-6606378b1087 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:54.407661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362a3b-a60e-4572-b7db-6606378b1087 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:54.408175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c362a3b-a60e-4572-b7db-6606378b1087 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:54.410037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 522/1021] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:54.415200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:54.415494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:54.415773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:54.437894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:54.437894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:54.540409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 500/1022] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:54.816276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c362a3b-a60e-4572-b7db-6606378b1087 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:54.919488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c362a3b-a60e-4572-b7db-6606378b1087 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:54.957172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:54.957827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:54.958138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:54.958413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:54.959608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:54.961067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d607fda-a3b7-4d31-b3ea-cb8e28451aee None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:54.963035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 523/1023] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:54.968763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:54.980550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:55.057648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26558cba-2357-4b89-9ed2-e13db3286ab6 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.057958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26558cba-2357-4b89-9ed2-e13db3286ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.058240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26558cba-2357-4b89-9ed2-e13db3286ab6 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.059733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 524/1024] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:55.065213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.065498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.065774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.077361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c89c5-5f53-4f19-a02b-05ed615df9c0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:55.083563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:55.084744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:55.086711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:55.113030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:55.113645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.113956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.114284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.114945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:55.116374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:55.146233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 501/1025] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:41:54 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:41:55.159391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 525/1026] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:55.431949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:55.494262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:55.535352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0dd2f-76e2-4384-9641-8b357aea0374 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:55.568673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:55.569306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.569584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.569853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] PATH_INFO: `/v3/services/image` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.570453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:55.571803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:55.580896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:55.581929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:55.583454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:55.584516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 502/1027] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 01:41:55 2022] GET /identity/v3/services/image => generated 86 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:55.588008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:55.685291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e2a12-5ab2-45f1-b5e0-e9184f0d548b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:55.719005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:55.719611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.719889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.720162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.720779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] RBAC: Adding query filter params (name=image) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:55.721077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:55.722452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:55.731967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 526/1028] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:55.734015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:55.833514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35ae54-7dce-4542-a71a-66bdb93b5b4c None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:55.859635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:55.868814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:55.869419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:55.869695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:55.869992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:55.870618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] RBAC: Adding query filter params (type=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:55.870917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:55.872269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:55.882523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 503/1029] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:55.884127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:55.887068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:55.986032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d22d-0eb6-4fe7-812e-5320ad1a85ad None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:56.019688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:56.020291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:56.020575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:56.020830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:56.021514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] RBAC: Adding query filter params (interface=public, service_id=922f68c2096945ba96e06b3c9598fe11, region_id=RegionOne) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:56.021818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:56.023186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ec7cf-787b-41cb-9d7c-877b295cad7f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:56.033295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 527/1030] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:41:55 2022] GET /identity/v3/endpoints?service_id=922f68c2096945ba96e06b3c9598fe11&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:56.034791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:56.135730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49558241-c360-4f96-92e9-d142043bdc94 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:56.169209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:56.169816 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:56.170221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:56.170377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:56.171500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:56.172861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88107cc-8413-471e-bc2c-e82bcf7e6c2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:56.179384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 504/1031] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:41:56 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:41:56.329059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572c45-71e8-4423-939d-b3c0c06ac430 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:56.329401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572c45-71e8-4423-939d-b3c0c06ac430 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:56.329614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df572c45-71e8-4423-939d-b3c0c06ac430 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:56.331193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 528/1032] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:56.336588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:56.336876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:56.337138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:56.356174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:56.357353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:56.411222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:56.429523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 505/1033] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:56 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:56.697991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572c45-71e8-4423-939d-b3c0c06ac430 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:56.774981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:56.812119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df572c45-71e8-4423-939d-b3c0c06ac430 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:56.847029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:56.847668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:56.847952 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:56.848226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:56.861122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:56.865925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:56.866860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:41:56.867706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:56.869934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 529/1034] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:41:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:56.873334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:56.974615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff8d44-eb43-49be-8a71-a75671e9385c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.008815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.009438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.009716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.010023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.010690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:57.010998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.012372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.021585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 506/1035] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:41:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:57.027317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.130289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf88464-d6f9-474b-87be-28f4dd45abe1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.160977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:57.171924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.172557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.172840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.173106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.183681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.185111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:57.200452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:57.201404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:57.207544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:57.207544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:57.207544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:57.207544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 530/1036] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:57.209171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.267556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:57.325319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9935e-5105-4cff-a531-2133336783f8 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.359719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.360327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.360609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.360881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.361514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:57.361819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.363202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f74a5bf-b38d-405d-a492-552c1f0682b2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.375605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 507/1037] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:57.380919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.385510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c5b9-1159-44ec-9191-612e61d60e90 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.385796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c5b9-1159-44ec-9191-612e61d60e90 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.386099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51c5b9-1159-44ec-9191-612e61d60e90 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.387542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 508/1038] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:41:57.393341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.393658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.394005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.413129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:57.414398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:57.492480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3a753-0eb4-4557-8e97-fca18e9ff522 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.497697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 509/1039] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:41:57.527852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.528412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.528697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.528973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.536290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.537710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:41:57.548542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:57.549500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:41:57.550526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:57.554287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 531/1040] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:57.555344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.595381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:57.655960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4546c3-cc2c-4ae9-8aea-a1cef430cefa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.690339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.690943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.691225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.691498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.692216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:57.692522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.693954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.710875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 510/1041] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:57.716318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.756682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:57.772327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.819859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b4307-ea9c-4192-b746-0f2fd6fd0a5e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.854674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.855458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.855840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.856216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.875088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:57.882086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3e84a3-bdd2-4250-9493-b737ddc14023 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:57.920497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:57.921754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:57.922119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:57.922460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:57.932351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:57.933804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:57.934136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:41:57.939551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:57.940708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:41:57.941784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:57.946519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 511/1042] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:57.947981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:57.978689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.049737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 532/1043] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:58.055355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.057706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa34651-0490-4fcc-bf2c-9f365713a26e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.095875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.096404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.096688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.097213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.097617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:58.097947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.099386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.112656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 512/1044] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:41:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:58.114179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.133514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.166170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b107-3532-43a1-988e-49b04a3d09de None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.203180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.203822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.204109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.204387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.211550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.215317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.216989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.229511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35822e5-a0eb-4ff7-8bc1-e913d7e83a51 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:41:58.236023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:58.237070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:41:58.238564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:41:58.238564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:41:58.238564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:58.238564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 533/1045] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:58.243139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.270713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.271348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.271635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.271914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] PATH_INFO: `/v3/users/fe5ca562a09942e88e5853c69c40c882` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.287011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] RBAC: Authorizing `identity:get_user(user_id=fe5ca562a09942e88e5853c69c40c882)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.288563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.294808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 513/1046] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/users/fe5ca562a09942e88e5853c69c40c882 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:58.295895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.363402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce77190-7e49-4785-9743-c6da366330cb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.375735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.397838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.398458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.398738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.399010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.399642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:58.399945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.400121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a637bed7-7727-4f34-ae75-b381a149d735 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.401289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbce044-100e-4d3c-876a-a02f32a7d29a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.412655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 534/1047] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:58.413801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587883e-5c9c-472a-aa42-bdb9c38fa9d8 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.414119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587883e-5c9c-472a-aa42-bdb9c38fa9d8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.414389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587883e-5c9c-472a-aa42-bdb9c38fa9d8 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.415737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 535/1048] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:41:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:41:58.418236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587883e-5c9c-472a-aa42-bdb9c38fa9d8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.435994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.436685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.436968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.437250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.469463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.505150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.506650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.519558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587883e-5c9c-472a-aa42-bdb9c38fa9d8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.552713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.553335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.553614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.553905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.560249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.562239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-9657c901-874d-4d71-9184-3bf177d51dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:41:58.572979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:58.574074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 536/1049] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:41:58.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.575978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.575978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.583736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.592424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:41:58.593630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:41:58.607472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 514/1050] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:41:58.608784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.658830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 537/1051] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:41:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:41:58.659571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.709770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.710466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92725-b791-442e-b7d4-a9791a0aecee None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.745686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.746323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.746607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.746884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.747575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:58.747883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.749850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.761532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 515/1052] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:58.767735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.778809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608e44a-3723-47e8-a389-ac304565c78b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.805203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.816150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.816801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.817079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.817361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.818753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.820179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.826903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 538/1053] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:41:58.828136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.879235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4d82d-5120-4244-8518-6990915be79b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.922601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.923131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.923410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.923683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.925135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] RBAC: Adding query filter params (role.id=51637f7de2fe4fe8aeb6a446f580c4a8, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:58.925253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.926692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.941901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 516/1054] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=51637f7de2fe4fe8aeb6a446f580c4a8 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:58.941901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:58.942233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da88c4-8ad1-48ac-b42b-6af6eab3df12 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:58.947075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:58.976664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:58.977325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:58.977655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:58.977959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:58.978694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6, user.id=fe5ca562a09942e88e5853c69c40c882) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:58.979002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:58.980446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:58.987704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 539/1055] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/role_assignments?user.id=fe5ca562a09942e88e5853c69c40c882&scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:59.058193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:59.062281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c80810-51ce-4c37-994f-8fa638d85c7f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:59.102941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:59.103707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:59.103993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:59.104268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] PATH_INFO: `/v3/services/image` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:59.104869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:59.106333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:41:59.116875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:41:59.118018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:41:59.118885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 517/1056] 10.222.0.33 () {56 vars in 1105 bytes} [Fri Sep 16 01:41:58 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:41:59.124973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:59.230605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343fa39a-cdb6-4131-aa65-ac0c3b04fa91 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:59.270494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:59.272707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:59.272707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:59.272707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:59.272707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] RBAC: Adding query filter params (name=image) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:59.272707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:59.273925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:59.284690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 540/1057] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:59.285644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:59.388194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89da5-fdbe-4ccc-ba74-9562707b13db None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:59.424707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:59.425383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:59.425665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:59.425971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:59.426602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] RBAC: Adding query filter params (type=image) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:41:59.426905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:59.428266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490851d2-33d4-4f27-9182-56fa96b33bdc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:59.438446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 518/1058] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:41:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:41:59.439561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:41:59.476339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:41:59.549991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02acd34-fb35-48f0-8336-187d86e872ee None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:41:59.582609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:41:59.583211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:41:59.583489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:41:59.583760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:41:59.584425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:41:59.585768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708dec79-44f6-4d4e-9767-d785fcbc75c0 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:41:59.611151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 541/1059] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:41:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:01.127102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd98-0786-4782-8a62-c3f2f6dfba5c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.127633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd98-0786-4782-8a62-c3f2f6dfba5c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.127633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615fd98-0786-4782-8a62-c3f2f6dfba5c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.129033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 519/1060] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:01.134170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.134587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.134764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.154736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:01.155990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:01.173026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2a41-f8f2-43ec-ab51-40853577a707 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.173412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2a41-f8f2-43ec-ab51-40853577a707 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.173751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb2a41-f8f2-43ec-ab51-40853577a707 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.175180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 520/1061] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:01.180118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.180404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.180680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.201014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:01.202893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:01.227431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:01.239086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 542/1062] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:01.279807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 521/1063] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:42:01.506368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.524632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:01.547334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.616967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae0d559-6e8c-4c4c-bb05-4bbb9a108614 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:01.648707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c555a740-dd6e-499d-b47c-8342992d9644 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:01.657271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:01.658056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.658358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.658620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.670136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:01.676021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:01.676984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:01.677857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 543/1064] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:01.682928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.686583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:01.687406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.687699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.687971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.698394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:01.703936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:01.704868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:01.705853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 522/1065] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:42:01.710886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.735753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:01.773183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:01.799593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e803aa4-b5a6-458b-a922-cbab1e730706 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:01.824642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42057a6-9065-40a8-926d-2e06838dbebb None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:01.837005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:01.837616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.837960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.838247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.838924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:01.839234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:01.840602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7aa87a-3699-49b9-8f3a-c3d77698075a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:01.849769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 544/1066] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:01.850974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33be95-0bc5-40d0-9d53-627af694ba2a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.851263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33be95-0bc5-40d0-9d53-627af694ba2a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.851545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33be95-0bc5-40d0-9d53-627af694ba2a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.852737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 545/1067] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:01.855120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33be95-0bc5-40d0-9d53-627af694ba2a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.866149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:01.866765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.867042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.867316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.867976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:01.868280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:01.869646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026e2a79-3500-476e-80fe-867b20a39766 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:01.882233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 523/1068] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:01.882233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.882233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.882233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:01.896595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:01.897780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:01.958964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33be95-0bc5-40d0-9d53-627af694ba2a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:01.969941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 524/1069] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:01.970822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:01.982810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:01.995674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:01.996322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:01.996601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:01.996886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.006841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.009396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.011413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:02.027248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:02.028215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:42:02.029729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:02.029729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.029729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:02.029729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 546/1070] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:02.034431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.086492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecaa6e2-0d62-48af-aa84-cdbd65fad3c9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.122456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.123091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.123373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.123648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] PATH_INFO: `/v3/users/fe5ca562a09942e88e5853c69c40c882` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.124818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] RBAC: Authorizing `identity:get_user(user_id=fe5ca562a09942e88e5853c69c40c882)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.126280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.132665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 525/1071] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:01 2022] GET /identity/v3/users/fe5ca562a09942e88e5853c69c40c882 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:02.133610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.148421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2e7d-d554-4a38-b28d-f02f23883872 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.184977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.185790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.186435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.186963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.187802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:02.188409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.190062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.203717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 547/1072] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:02.209502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.215642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.245045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda2bdd-a2e9-4a66-9fcb-5d519ca9590b None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.269716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.281081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.281651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.281967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.282239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.283338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.285151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.286410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 526/1073] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:02.287161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.318610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124dde9e-558f-449f-ab39-444b2ab9c42e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.352012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.352641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.352925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.353210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.360676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.362135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:42:02.373580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:02.374734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 548/1074] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:02.376002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.385824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e991ed4-59fc-42e6-b6b5-7a4cce689972 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.420128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.421272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.421545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.421807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.436921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.472757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74071bb1-42ca-4866-a248-7ea7ff9c4ac5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.485522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.490374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.491824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.506874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.507546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.507915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.508098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6/users/fe5ca562a09942e88e5853c69c40c882/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.510015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c06a5503e6a94196a9a9d8734ba2dfa6, user_id=fe5ca562a09942e88e5853c69c40c882, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.511418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.527466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 549/1075] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:42:02 2022] PUT /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6/users/fe5ca562a09942e88e5853c69c40c882/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:42:02.528307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.610127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 527/1076] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:02.614580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.656604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fe290-4138-4991-b165-5e9708a0a6f3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.665482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.694421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.695037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.695314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.695586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.696314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:02.696617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.698921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.722204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 550/1077] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:02.727507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.728100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1c842-f6b6-4bad-bafd-646dea3fc724 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.762339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.766723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.767357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.767635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.767907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.778137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.779572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:02.794984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:02.796040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:42:02.796973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:02.796973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.796973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:02.796973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 528/1078] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:02.804093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.844912 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061b5d-6825-4d94-9955-35111030e571 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.881837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.882408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.882685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.882951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.895181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.896633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.908386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:02.912733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6db423-ae95-47df-9c7b-3ed1ef4e8827 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:02.913228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:02.914207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:42:02.915138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:02.915138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:02.915138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:02.919151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 551/1079] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:42:02.919797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:02.951356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:02.952489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:02.952765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:02.953038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:02.953679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:02.954013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:02.955437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:02.967948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 529/1080] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:03.020956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:03.042598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d7965-73b6-4962-8d41-abe52c6ca796 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:03.079938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:03.080750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:03.081036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:03.081308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:03.081989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:03.082296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:03.083681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:03.096613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 552/1081] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:03.102655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:03.208657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41589397-95bf-4ecd-beeb-0236e2b25161 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:03.243910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:03.244616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:03.244901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:03.245173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:03.252431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:03.253918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:42:03.266834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:03.267810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:03.268716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 530/1082] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:42:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:03.274919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:03.378628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea170168-d54a-43d4-8d8f-ff744e6f85da None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:03.412010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:03.412642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:03.412927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:03.413205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:03.413939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:03.414254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:03.415712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26f134-a51f-4c0b-bf31-d9e4f317e74d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:03.428473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 553/1083] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:42:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:03.434340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:03.453364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:03.532763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859d10f-a620-4932-912a-ef2d3b116555 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:03.565646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:03.566322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:03.566605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:03.566881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/51637f7de2fe4fe8aeb6a446f580c4a8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:03.568992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=6e5607c5bb0f43cc9e79e6e0351077a0, role_id=51637f7de2fe4fe8aeb6a446f580c4a8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:03.570469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd1864-9943-45f3-bdbd-a01d19795963 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:03.583138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 531/1084] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:42:03 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/6e5607c5bb0f43cc9e79e6e0351077a0/roles/51637f7de2fe4fe8aeb6a446f580c4a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:42:04.672766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68929a-c6fb-4ebc-9e58-bf7d175f72c0 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:04.673305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68929a-c6fb-4ebc-9e58-bf7d175f72c0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:04.673305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68929a-c6fb-4ebc-9e58-bf7d175f72c0 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:04.674606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 554/1085] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:04.680025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:04.680459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:04.680646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:04.699009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:04.700184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:04.765156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 532/1086] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:05.032543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68929a-c6fb-4ebc-9e58-bf7d175f72c0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:05.035564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.139205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68929a-c6fb-4ebc-9e58-bf7d175f72c0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:05.173692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:05.174350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.174639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.174919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.185768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:05.191187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:05.192122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:05.193109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 555/1087] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:05.198376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:05.208500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.300316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c298d05a-8c82-4f1d-8e9e-eb60f19a9cfb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:05.334487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:05.335100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.335381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.335652 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.336312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:05.336616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:05.338013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:05.346427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 533/1088] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:05.352372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:05.413050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.451684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d575af-5708-4a84-8a90-f70cc4e6bba8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:05.484576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:05.485202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.485485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.485762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] PATH_INFO: `/v3/users/fe5ca562a09942e88e5853c69c40c882` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.486921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] RBAC: Authorizing `identity:get_user(user_id=fe5ca562a09942e88e5853c69c40c882)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:05.488346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f3258c-11df-455d-912c-b9006e3921f6 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:05.490140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 556/1089] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/users/fe5ca562a09942e88e5853c69c40c882 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:05.495648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:05.564573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.598911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e241078-7815-4c7c-bb1d-c52a27280d08 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:05.634255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:05.634861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.635143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.635418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.701430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:05.702997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:05.704059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5d74-4c68-41b3-a111-adc74ac8fcc6 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.704464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5d74-4c68-41b3-a111-adc74ac8fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.704625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf5d74-4c68-41b3-a111-adc74ac8fcc6 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.705983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 557/1090] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:42:05.710947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.711237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.711518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.729697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:05.730922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:05.769426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.796692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 558/1091] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:42:05.809775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 534/1092] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:05.812380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:05.871735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:05.912369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74bc0a-bfdc-4e5f-9519-8fa53675edb9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:05.945644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:05.946500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:05.946787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:05.947061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:05.948176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:05.949577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:05.951240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 559/1093] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:05.957357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.053797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12cf86-b15b-4998-8cbb-7b1717ac0a16 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.076234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.086966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.087566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.087844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.088122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.088837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6, user.id=fe5ca562a09942e88e5853c69c40c882) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:06.089144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:06.090604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:06.096296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 535/1094] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:05 2022] GET /identity/v3/role_assignments?user.id=fe5ca562a09942e88e5853c69c40c882&scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:06.181503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e23cb9a-38e0-4d89-a317-3d43964d11fa None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.209416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:06.217702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.218385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.218668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.218943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.236374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:06.241440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:06.242479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:06.243544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 560/1095] 10.222.0.33 () {56 vars in 1120 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:42:06.249802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.290358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:06.357328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbaa25-350d-45d4-af86-473d4ebe3cce None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.390592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.391198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.391483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.391755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.392410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:06.392712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:06.394108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:06.401953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 536/1096] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:06.408120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.504462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda069a-38dd-41c2-9695-535dd92b0dd6 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.537201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.537814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.538120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.538391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.548031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:06.549451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:06.563892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:06.569392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:42:06.570435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:06.570435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:06.570435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:06.570435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 561/1097] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:06.570706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.663273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:06.669373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0d42d-3a54-4682-9555-c83ea7659a31 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.702626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.703244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.703494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.703767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.704395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:06.704698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:06.706079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:06.718019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 537/1098] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:06.723539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.765110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:06.822609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90890cd6-1a77-469c-87f0-20612864c036 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:06.854481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:06.855115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:06.855400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:06.855674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:06.863580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:06.865006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:42:06.876433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:06.877625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:06.878661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 562/1099] 10.222.0.33 () {56 vars in 1093 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:42:06.883190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:06.982542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865f9ea-66ae-42a8-be2a-92c275501ee1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.018431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.018971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.019254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.019526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.020259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:07.020567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.022111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.039751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 538/1100] 10.222.0.33 () {56 vars in 1133 bytes} [Fri Sep 16 01:42:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:07.045395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:07.139993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:07.142934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899c8a2-c213-4842-aadd-cd31734e8805 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.176056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.176657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.176940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.177212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.240953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.242437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.347869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:07.356858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 563/1101] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 16 01:42:07.357837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:07.373851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:07.456577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bfd465-a816-418b-b111-54958715e5ea None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.488910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.489524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.489806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.490104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.500267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.501690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:07.515948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:07.516979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:42:07.517973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:07.517973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:42:07.517973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:07.517973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 539/1102] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:07.522754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:07.615881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa2748f-9586-4763-bcd2-4113bf9e133f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.649535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.650169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.650447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.650717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.651355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:07.651655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.653074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.664634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 564/1103] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:07.670266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:07.735020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:07.769633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6f400-3dce-40cd-b184-66bec834b0d6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.802775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.803333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.803610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.803881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.810342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.811785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:42:07.822663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:07.823736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:07.824706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 540/1104] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:07.829602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:07.887292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:07.927506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cb801-641c-4e1f-bd2b-d1a1343abb51 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:07.961346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:07.961975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:07.962259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:07.962532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:07.963218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:07.963524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:07.964941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf2087-9e8b-4d5f-8e24-ae1f45deac64 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:07.977048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 565/1105] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:07.983031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:08.081001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc216eca-8f0a-45f9-9cb9-0b5d2e750808 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:08.105534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:08.115008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:08.115605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:08.115883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:08.116153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:08.116861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] RBAC: Adding query filter params (role.id=51637f7de2fe4fe8aeb6a446f580c4a8, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=6e5607c5bb0f43cc9e79e6e0351077a0) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:08.117164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:08.118607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f103409-5fde-4cf7-a17c-3eb4eacfb3c6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:08.133896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 541/1106] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:07 2022] GET /identity/v3/role_assignments?user.id=6e5607c5bb0f43cc9e79e6e0351077a0&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=51637f7de2fe4fe8aeb6a446f580c4a8 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:08.313205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251110c-4c50-4df0-b363-f4bd4a26e4ac None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:08.313498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251110c-4c50-4df0-b363-f4bd4a26e4ac None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:08.313775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251110c-4c50-4df0-b363-f4bd4a26e4ac None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:08.315187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 566/1107] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:42:08.320533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:08.320822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:08.321102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:08.339582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:08.340701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:08.407762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 542/1108] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:08.673173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251110c-4c50-4df0-b363-f4bd4a26e4ac None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:08.775477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251110c-4c50-4df0-b363-f4bd4a26e4ac None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:08.795331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:08.809516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:08.810246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:08.810529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:08.810828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:08.812512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:08.813991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b35e7-a8a9-4285-ae91-95d03787b6bb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:08.815887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 567/1109] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:08.821591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:08.924500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6fd2a-f0b7-45bb-8960-1fee48f41424 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:08.945799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:08.963217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:08.963836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:08.964114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:08.964382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:08.965600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:08.966560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b2af37-259c-474f-bcfb-0dc1b49c1f65 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:08.988734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 543/1110] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:42:08 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:11.122491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8074dd5-22a1-407d-bb2c-2198f5ecde3f None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:11.123036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8074dd5-22a1-407d-bb2c-2198f5ecde3f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:11.123036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8074dd5-22a1-407d-bb2c-2198f5ecde3f None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:11.124392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 568/1111] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:11.129580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:11.129998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:11.130167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:11.148590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:11.149768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:11.213610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 544/1112] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:11.478824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8074dd5-22a1-407d-bb2c-2198f5ecde3f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:11.577175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8074dd5-22a1-407d-bb2c-2198f5ecde3f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:11.609405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:11.610044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:11.610333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:11.610608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] PATH_INFO: `/v3/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:11.611978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] RBAC: Authorizing `identity:get_role(role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:11.613323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:11.614623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 569/1113] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:11 2022] GET /identity/v3/roles/1ef4118652b24050b863bd53ae59decc => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:11.620199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:11.715196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a50c20-2832-4c86-8e4c-1b44ecc92c24 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:11.722145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:11.749180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:11.749802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:11.750097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:11.750365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] PATH_INFO: `/v3/users/11a094b26da74d80a6fc9f3561907e59` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:11.762979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] RBAC: Authorizing `identity:get_user(user_id=11a094b26da74d80a6fc9f3561907e59)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:11.765278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:11.766866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 545/1114] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:11 2022] GET /identity/v3/users/11a094b26da74d80a6fc9f3561907e59 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:11.772622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:11.826306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:11.868058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e6fa-68b9-4149-a89b-8f84dfc42553 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:11.900658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:11.901250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:11.901533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:11.901808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:11.968701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:11.970181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:12.022432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:12.066791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 570/1115] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:12.072596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:12.169970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1681652-be78-4ea0-86e3-6a78e983ab2e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:12.202860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:12.203476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:12.203755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:12.204026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:12.205116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:12.206638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd64aa0-b397-409b-ae8b-52a9a609b5dd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:12.208221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 546/1116] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:12 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:12.214246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:12.312785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12f45cd-ff39-4ea9-a546-6017cdb8e5b3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:12.345195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:12.345791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:12.346096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:12.346364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:12.347068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6, user.id=11a094b26da74d80a6fc9f3561907e59) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:12.347371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:12.348778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cfefa0-7b80-499b-a494-012bc5aaeb9d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:12.354073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 571/1117] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:12 2022] GET /identity/v3/role_assignments?user.id=11a094b26da74d80a6fc9f3561907e59&scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6&role.id=1ef4118652b24050b863bd53ae59decc => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:14.450939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445b79-39ea-49fb-a861-d20e33ee29dc None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:14.451959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445b79-39ea-49fb-a861-d20e33ee29dc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:14.452085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07445b79-39ea-49fb-a861-d20e33ee29dc None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:14.453345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 547/1118] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:14.458444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:14.458822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:14.458991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:14.478061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:14.479237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:14.492575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:14.542948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 572/1119] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:14.808929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445b79-39ea-49fb-a861-d20e33ee29dc None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:14.840023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:14.908499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07445b79-39ea-49fb-a861-d20e33ee29dc None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:14.941755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:14.942396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:14.942677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:14.942949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] PATH_INFO: `/v3/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:14.944318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] RBAC: Authorizing `identity:get_role(role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:14.945678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:14.947029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 548/1120] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:14 2022] GET /identity/v3/roles/1ef4118652b24050b863bd53ae59decc => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:14.953069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:15.054960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a27b17b-5322-448c-9f0e-138eadf6df7c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:15.087074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:15.087629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:15.087907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:15.088177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] PATH_INFO: `/v3/users/11a094b26da74d80a6fc9f3561907e59` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:15.089272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] RBAC: Authorizing `identity:get_user(user_id=11a094b26da74d80a6fc9f3561907e59)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:15.090696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:15.092261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 573/1121] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:14 2022] GET /identity/v3/users/11a094b26da74d80a6fc9f3561907e59 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:15.098100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:15.192265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:15.195202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d8d64-fcd3-4eb6-b27e-884055f4e05d None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:15.229619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:15.230270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:15.230549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:15.230823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:15.231919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:15.233364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c9bb90-8f1f-4a21-98e0-b5381c15a029 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:15.234990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 549/1122] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:15 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:15.240976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:15.260015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:15.340286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3de7-f8bf-4e14-88b2-8b5f9bb99a45 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:15.371681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:15.372328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:15.372611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:15.372883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6/users/11a094b26da74d80a6fc9f3561907e59/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:15.375536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c06a5503e6a94196a9a9d8734ba2dfa6, user_id=11a094b26da74d80a6fc9f3561907e59, role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:15.376945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d0ff64-7f48-4a6f-8193-1b72003d82f9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:15.389657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 574/1123] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:42:15 2022] PUT /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6/users/11a094b26da74d80a6fc9f3561907e59/roles/1ef4118652b24050b863bd53ae59decc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:42:17.525346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896790-83b5-4e1d-96bb-2b048e006fb8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:17.525886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896790-83b5-4e1d-96bb-2b048e006fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:17.525886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a896790-83b5-4e1d-96bb-2b048e006fb8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:17.527179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 550/1124] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:17.532568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:17.532943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:17.533121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:17.550694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:17.551862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:17.615070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 575/1125] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:17.885600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a896790-83b5-4e1d-96bb-2b048e006fb8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:17.991398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a896790-83b5-4e1d-96bb-2b048e006fb8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:18.023547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:18.024160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:18.024439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:18.024713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] PATH_INFO: `/v3/roles/1ef4118652b24050b863bd53ae59decc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:18.026099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] RBAC: Authorizing `identity:get_role(role_id=1ef4118652b24050b863bd53ae59decc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:18.027445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:18.028723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 551/1126] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:17 2022] GET /identity/v3/roles/1ef4118652b24050b863bd53ae59decc => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:18.035055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:18.044884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:18.133678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea4c1d-9063-45b0-b1db-7f222fc03828 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:18.166124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:18.166687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:18.166969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:18.167242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] PATH_INFO: `/v3/users/11a094b26da74d80a6fc9f3561907e59` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:18.168342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] RBAC: Authorizing `identity:get_user(user_id=11a094b26da74d80a6fc9f3561907e59)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:18.169768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:18.171881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 576/1127] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:18 2022] GET /identity/v3/users/11a094b26da74d80a6fc9f3561907e59 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:18.177610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:18.212421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:18.275194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a1835-46cf-478a-a3ce-5f4402829c6a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:18.308609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:18.309204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:18.309486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:18.309758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:18.373840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:18.375304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:18.407371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:18.469459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 552/1128] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:18.475269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:18.548987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:18.570903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4017bc-75c4-4a60-b589-aa31acef3db4 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:18.603166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:18.603763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:18.604045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:18.604318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] PATH_INFO: `/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:18.605429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] RBAC: Authorizing `identity:get_project(project_id=c06a5503e6a94196a9a9d8734ba2dfa6)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:18.606869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bf173-03a4-4fc4-a9c5-6cbe7630d674 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:18.609049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 577/1129] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:18 2022] GET /identity/v3/projects/c06a5503e6a94196a9a9d8734ba2dfa6 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:18.614963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:18.711745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a95feb-46bd-415e-8af1-ce740a9c66b1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:18.744605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:18.745140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:18.745421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:18.745694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:18.746438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] RBAC: Adding query filter params (role.id=1ef4118652b24050b863bd53ae59decc, scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6, user.id=11a094b26da74d80a6fc9f3561907e59) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:18.746748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:18.748190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ec9d9-67f7-4110-9507-d06ba673e03c None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:18.750962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:18.754602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 553/1130] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:18 2022] GET /identity/v3/role_assignments?user.id=11a094b26da74d80a6fc9f3561907e59&scope.project.id=c06a5503e6a94196a9a9d8734ba2dfa6&role.id=1ef4118652b24050b863bd53ae59decc => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:20.879080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a34c-497e-471c-99e0-554be524f764 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:20.879619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a34c-497e-471c-99e0-554be524f764 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:20.879619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710a34c-497e-471c-99e0-554be524f764 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:20.880945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 578/1131] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:20.886055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:20.886455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:20.886606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:20.905685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:20.906901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:20.970601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 554/1132] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:21.233170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a34c-497e-471c-99e0-554be524f764 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:21.335894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710a34c-497e-471c-99e0-554be524f764 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:21.368655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:21.369272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:21.369555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:21.369826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:21.370960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:21.372367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2c985-d52f-451e-bdf5-895f3c330cf2 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:21.373960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 579/1133] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:21.379777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:21.475727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644269c5-6288-45fe-8992-a72923561ff6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:21.503395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:21.509027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:21.509625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:21.509928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:21.510203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:21.510855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:21.512278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a2cf42-c3fa-4ff1-8d1e-5d7d21d10956 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:21.538275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 555/1134] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:42:21 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:23.730137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28cbb-9376-4bbe-af77-1cb523c62458 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:23.730696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28cbb-9376-4bbe-af77-1cb523c62458 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:23.730696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b28cbb-9376-4bbe-af77-1cb523c62458 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:23.731948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 580/1135] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:23.737186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:23.737616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:23.737727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:23.756357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:23.757536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:23.821943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 556/1136] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:24.090526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28cbb-9376-4bbe-af77-1cb523c62458 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:24.105516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:24.188119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b28cbb-9376-4bbe-af77-1cb523c62458 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:24.220819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:24.221433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:24.221715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:24.222018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:24.223123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:24.224538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ce0a8-e4a4-43c3-bc35-2c4b89a4c5c3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:24.226110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 581/1137] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:42:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:24.231899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:24.333758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bd7e3-952c-48f6-9f53-cd16d90f07c4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:24.348127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:24.371295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:24.371905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:24.372186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:24.372460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:24.373107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:24.374573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb53bcd-92d2-4d37-90f9-91d7dc4eeaa1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:24.395231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 557/1138] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:42:24 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:26.568521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47718f-c139-4d9a-9012-b29da54a1092 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:26.569024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47718f-c139-4d9a-9012-b29da54a1092 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:26.569024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47718f-c139-4d9a-9012-b29da54a1092 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:26.570358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 582/1139] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:26.575586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:26.576543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:26.576740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:26.594422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:26.595589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:26.659169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 558/1140] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:26.932398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47718f-c139-4d9a-9012-b29da54a1092 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.011655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:27.031783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47718f-c139-4d9a-9012-b29da54a1092 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.066411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.067359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.067645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.067926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.078293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:27.083034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:27.084121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:27.085131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 583/1141] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:27.090676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.182570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:27.186560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed545894-73a5-4d04-8062-fa652aabe707 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.220823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.221422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.221701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.222001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.222654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:27.222956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:27.224305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:27.231917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 559/1142] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:27.237697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.338663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc84daa-558d-4a87-a28c-c3be01b11bd2 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.371445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.372064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.372350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.372630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] PATH_INFO: `/v3/users/d838b7ccf7ed4231983baefdfaef64a8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.383218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:27.386874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] RBAC: Authorizing `identity:get_user(user_id=d838b7ccf7ed4231983baefdfaef64a8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:27.389085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:27.390706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 584/1143] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:27 2022] GET /identity/v3/users/d838b7ccf7ed4231983baefdfaef64a8 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:27.396445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.492623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58d9f7-bdad-4215-83bc-1dec96fde139 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.524208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.524794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.525075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.525348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.552746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:27.590317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:27.592311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:27.686043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 560/1144] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:27.691933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.789081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b832-6c95-4694-92c4-5bf00ffc9e0f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.822398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.823097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.823377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.823650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] PATH_INFO: `/v3/projects/dff0e82b861149a99887f0506cd3f667` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.824757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] RBAC: Authorizing `identity:get_project(project_id=dff0e82b861149a99887f0506cd3f667)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:27.826218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245b8e5-e29f-4092-93bd-96b150fc6941 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:27.827828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 585/1145] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:27 2022] GET /identity/v3/projects/dff0e82b861149a99887f0506cd3f667 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:27.834012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:27.891108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:27.931191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f630b008-c08d-4514-bf12-0dae94f71cc0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:27.963630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:27.964222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:27.964499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:27.964769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:27.965474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=dff0e82b861149a99887f0506cd3f667, user.id=d838b7ccf7ed4231983baefdfaef64a8) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:27.965779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:27.967294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838af0f-b0cf-4eec-8195-17710f92c5c2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:27.972412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 561/1146] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:27 2022] GET /identity/v3/role_assignments?user.id=d838b7ccf7ed4231983baefdfaef64a8&scope.project.id=dff0e82b861149a99887f0506cd3f667&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:30.086525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcfbf6-e330-4eea-8d86-1c879c25bd41 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:30.087056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcfbf6-e330-4eea-8d86-1c879c25bd41 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:30.087145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcfbf6-e330-4eea-8d86-1c879c25bd41 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:30.088422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 586/1147] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:30.094369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:30.094764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:30.094923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:30.112497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:30.113670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:30.180213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 562/1148] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:30.444933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcfbf6-e330-4eea-8d86-1c879c25bd41 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:30.512323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:30.547335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcfbf6-e330-4eea-8d86-1c879c25bd41 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:30.580401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:30.581019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:30.581303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:30.581580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:30.591298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:30.595992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:30.597105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:30.598177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 587/1149] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:30.603107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:30.656348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:30.699794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a35e93-071c-4974-9caf-7b364316d8d1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:30.732604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:30.733215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:30.733497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:30.733770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:30.734463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:30.734771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:30.736142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:30.744564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 563/1150] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:30.750918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:30.845491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f8fc5c-1386-4973-ac88-28119c637dbd None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:30.869983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:30.879185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:30.879799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:30.880081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:30.880355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] PATH_INFO: `/v3/users/d838b7ccf7ed4231983baefdfaef64a8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:30.881466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] RBAC: Authorizing `identity:get_user(user_id=d838b7ccf7ed4231983baefdfaef64a8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:30.882908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:30.884449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 588/1151] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:30 2022] GET /identity/v3/users/d838b7ccf7ed4231983baefdfaef64a8 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:30.890459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:30.988073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b81fc6-388e-482d-9811-7390b3efb050 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:31.003342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:31.020919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:31.021539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:31.021825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:31.022121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] PATH_INFO: `/v3/projects/dff0e82b861149a99887f0506cd3f667` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:31.023225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=dff0e82b861149a99887f0506cd3f667)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:31.024651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a9af25-7e96-49e1-bb7a-adfe93dcf8e1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:31.026296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 564/1152] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:30 2022] GET /identity/v3/projects/dff0e82b861149a99887f0506cd3f667 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:31.032832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:31.156837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f117d8d6-5461-4664-85f9-c183886aeb29 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:31.189334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:31.190046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:31.190327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:31.190595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] PATH_INFO: `/v3/projects/dff0e82b861149a99887f0506cd3f667/users/d838b7ccf7ed4231983baefdfaef64a8/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:31.192462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] RBAC: Authorizing `identity:create_grant(project_id=dff0e82b861149a99887f0506cd3f667, user_id=d838b7ccf7ed4231983baefdfaef64a8, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:31.193889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5322b63-f49a-43ce-86ca-f280dc60e820 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:31.207284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 589/1153] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:42:31 2022] PUT /identity/v3/projects/dff0e82b861149a99887f0506cd3f667/users/d838b7ccf7ed4231983baefdfaef64a8/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:42:33.290878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130c29-3d18-4bca-bb23-353df993b0b0 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:33.291332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130c29-3d18-4bca-bb23-353df993b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:33.291441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130c29-3d18-4bca-bb23-353df993b0b0 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:33.292759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 565/1154] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:33.298593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:33.299002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:33.299137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:33.316717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:33.317911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:33.365079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:33.383659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 590/1155] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:33.655784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d130c29-3d18-4bca-bb23-353df993b0b0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:33.754972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d130c29-3d18-4bca-bb23-353df993b0b0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:33.787998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:33.788619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:33.788903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:33.789185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:33.799891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:33.804695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:33.805860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:33.807026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 566/1156] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:33.812331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:33.906515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22143c21-75c9-42c5-bd94-7ef97da27f8a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:33.939504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:33.940099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:33.940385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:33.940663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:33.941321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:33.941629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:33.943026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:33.952384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 591/1157] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:42:33.958190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:34.003158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:34.057343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef773-1df0-441e-bc49-69776c7e883f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:34.089071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:34.089693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:34.090004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:34.090285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] PATH_INFO: `/v3/users/d838b7ccf7ed4231983baefdfaef64a8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:34.091917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] RBAC: Authorizing `identity:get_user(user_id=d838b7ccf7ed4231983baefdfaef64a8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:34.093350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:34.094946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 567/1158] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:33 2022] GET /identity/v3/users/d838b7ccf7ed4231983baefdfaef64a8 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:34.100669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:34.145361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:34.197278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2280b668-4dbd-4fc1-846e-dd6ec41493b3 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:34.229200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:34.229789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:34.230092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:34.230362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:34.294282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:34.296274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:34.337615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:34.390063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 592/1159] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:34.396020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:34.491863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b621b7a6-f23c-4f2d-bcb8-42c74926e577 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:34.503875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:34.524624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:34.525240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:34.525521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:34.525794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] PATH_INFO: `/v3/projects/dff0e82b861149a99887f0506cd3f667` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:34.526925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] RBAC: Authorizing `identity:get_project(project_id=dff0e82b861149a99887f0506cd3f667)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:34.528349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d33e861-e5f1-4501-8884-fc2d04010da9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:34.530050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 568/1160] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:34 2022] GET /identity/v3/projects/dff0e82b861149a99887f0506cd3f667 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:34.536135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:34.630291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551acd1-d4cc-42cc-a490-6be300984dac None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:34.662510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:34.663097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:34.663380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:34.663661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:34.664379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=dff0e82b861149a99887f0506cd3f667, user.id=d838b7ccf7ed4231983baefdfaef64a8) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:34.664690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:34.666122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ca7ebb-e853-42e6-b8c1-39ab31a7a4a1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:34.672146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 593/1161] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:34 2022] GET /identity/v3/role_assignments?user.id=d838b7ccf7ed4231983baefdfaef64a8&scope.project.id=dff0e82b861149a99887f0506cd3f667&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:36.808678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d942-5321-4105-8576-534725ccc142 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:36.809237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d942-5321-4105-8576-534725ccc142 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:36.809237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a503d942-5321-4105-8576-534725ccc142 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:36.810609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 569/1162] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:36.815724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:36.816148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:36.816274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:36.834386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:36.835553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:36.838196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:36.900245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 594/1163] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:37.168690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503d942-5321-4105-8576-534725ccc142 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:37.267859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a503d942-5321-4105-8576-534725ccc142 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:37.301740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:37.302369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:37.302654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:37.302928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:37.348659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:37.368681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:37.370149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:37.464902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 570/1164] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:37.471394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:37.565154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32b1da8-1a46-468c-a931-acec5818e0ab None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:37.597721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:37.598352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:37.598636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:37.598906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:37.605223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:37.606699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:37.609049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b581c134-c196-4ef9-954b-695d66e0f3a0 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:37.618680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:37.619913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:37.620965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 595/1165] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:42:37 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:37.625692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:37.704550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:37.723759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444bbf25-4049-4061-9560-b619b22535b6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:37.756634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:37.757222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:37.757501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:37.757793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:37.758421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:37.758722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:37.760074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218148f-5f70-442c-b1e9-204d7bb736ba None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:37.767206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 571/1166] 10.222.0.33 () {56 vars in 1115 bytes} [Fri Sep 16 01:42:37 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:39.878668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b8ce-91d7-414c-ae78-32e0a1384d8e None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:39.879203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b8ce-91d7-414c-ae78-32e0a1384d8e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:39.879203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b2b8ce-91d7-414c-ae78-32e0a1384d8e None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:39.880546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 596/1167] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:39.885694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652af3e-171e-4c82-9429-ce2f0c7370c6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:39.886093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652af3e-171e-4c82-9429-ce2f0c7370c6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:39.886280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652af3e-171e-4c82-9429-ce2f0c7370c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:39.905367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d652af3e-171e-4c82-9429-ce2f0c7370c6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:39.906587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d652af3e-171e-4c82-9429-ce2f0c7370c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:39.970688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 572/1168] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:40.235395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2b8ce-91d7-414c-ae78-32e0a1384d8e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:40.335366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b2b8ce-91d7-414c-ae78-32e0a1384d8e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:40.366693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:40.367283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:40.367567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:40.367841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:40.368500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:40.369852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606e7968-fd04-4f97-832d-dc9452c59fc4 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:40.385294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 597/1169] 10.222.0.33 () {60 vars in 1138 bytes} [Fri Sep 16 01:42:40 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:42.517041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5d18-e97b-46f7-b4cd-938b6316101f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:42.517570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5d18-e97b-46f7-b4cd-938b6316101f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:42.517694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba5d18-e97b-46f7-b4cd-938b6316101f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:42.518972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 573/1170] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:42.524130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:42.524509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:42.524632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:42.542933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:42.544738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:42.597341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:42.609326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 598/1171] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:42.874754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5d18-e97b-46f7-b4cd-938b6316101f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:42.948089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:42.972711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba5d18-e97b-46f7-b4cd-938b6316101f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:43.005508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:43.006146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:43.006427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:43.006699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] PATH_INFO: `/v3/domains/a451f925137949768c7510eee688a7a0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:43.016925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=a451f925137949768c7510eee688a7a0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:43.018400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a86e2-b88a-418b-9b94-6552567ea8bb None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:43.019943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 574/1172] 10.222.0.33 () {56 vars in 1183 bytes} [Fri Sep 16 01:42:42 2022] GET /identity/v3/domains/a451f925137949768c7510eee688a7a0 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:43.025634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:43.124145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ba305-ee77-4151-b848-2de53c0e4f32 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:43.157156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:43.157694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:43.158002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:43.158279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:43.158936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:43.160359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04dda0-5622-48ec-bde8-df1c786a7ece None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:43.185881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 599/1173] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:42:43 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:42:45.359162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c814-900a-4034-b5f0-1830c384a2f7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:45.359664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c814-900a-4034-b5f0-1830c384a2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:45.359757 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42c814-900a-4034-b5f0-1830c384a2f7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:45.361020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 575/1174] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:45.366138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:45.366576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:45.366679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:45.384456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:45.385639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:45.420193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:45.450517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 600/1175] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:45.716716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c814-900a-4034-b5f0-1830c384a2f7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:45.816082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42c814-900a-4034-b5f0-1830c384a2f7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:45.852267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:45.853057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:45.853483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:45.853824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] PATH_INFO: `/v3/domains/a451f925137949768c7510eee688a7a0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:45.854966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=a451f925137949768c7510eee688a7a0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:45.856900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f0005-fd0b-496c-9b4e-4a83437e6f4b None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:45.858474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 576/1176] 10.222.0.33 () {56 vars in 1183 bytes} [Fri Sep 16 01:42:45 2022] GET /identity/v3/domains/a451f925137949768c7510eee688a7a0 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:45.864443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:45.959803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c9bca7-e36d-4b54-aa84-1b06a98739b8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:45.992372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:45.992907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:45.993188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:45.993460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:45.994315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:45.995745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e766e8-d563-41c7-bb47-02a8267ea826 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:46.016932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 601/1177] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:42:45 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:42:48.180742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f12eb-d41c-4ce0-866b-1bd5354f0b42 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:48.181315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f12eb-d41c-4ce0-866b-1bd5354f0b42 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:48.181315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f12eb-d41c-4ce0-866b-1bd5354f0b42 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:48.182627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 577/1178] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:48.187954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:48.188344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:48.188518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:48.206863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:48.208060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:48.230730 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:48.278273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 602/1179] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:48.551281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f12eb-d41c-4ce0-866b-1bd5354f0b42 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:48.554206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:48.650802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f12eb-d41c-4ce0-866b-1bd5354f0b42 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:48.683200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:48.683814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:48.684094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:48.684960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:48.694699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:48.699419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:48.700525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:48.701586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 578/1180] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:48.706423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:48.803867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92ce43-7156-4697-b6e9-8da9a8e6cf17 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:48.836675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:48.837266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:48.837546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:48.837820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:48.838497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:48.838800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:48.840154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:48.847850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 603/1181] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:48.853809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:48.918357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:48.957189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38dc0-aa94-4b4d-acfb-7bc1c558d8ce None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:48.990064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:48.990683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:48.990960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:48.991229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] PATH_INFO: `/v3/users/924e307a4ffe4cc3821f678f36d3ad3d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:49.004283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] RBAC: Authorizing `identity:get_user(user_id=924e307a4ffe4cc3821f678f36d3ad3d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:49.005711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:49.007309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 579/1182] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:48 2022] GET /identity/v3/users/924e307a4ffe4cc3821f678f36d3ad3d => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:49.013041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:49.035056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:49.110416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175767b-b481-4c6e-99db-12d65efff1e5 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:49.141776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:49.142407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:49.142689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:49.142960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:49.206524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:49.207956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:49.227565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:49.303340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 604/1183] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:49.309312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:49.404501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d99f7-54d7-4e48-9792-db48fd807954 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:49.423475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:49.437184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:49.437804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:49.438110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:49.438383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] PATH_INFO: `/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:49.439472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] RBAC: Authorizing `identity:get_project(project_id=eb887eaf6d334fdfa1f41a9e11c6be9a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:49.440887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1e2f18-a77d-495e-a8e7-cb878fed7b67 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:49.442507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 580/1184] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:49 2022] GET /identity/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:49.448744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:49.544621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180b678-cd79-483b-b007-7348e91f9961 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:49.564027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:49.577601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:49.578226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:49.578510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:49.578784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:49.579497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=eb887eaf6d334fdfa1f41a9e11c6be9a, user.id=924e307a4ffe4cc3821f678f36d3ad3d) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:49.579807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:49.581212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8585e-44a5-4783-8781-0e59be61a442 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:49.586499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 605/1185] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:49 2022] GET /identity/v3/role_assignments?user.id=924e307a4ffe4cc3821f678f36d3ad3d&scope.project.id=eb887eaf6d334fdfa1f41a9e11c6be9a&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:51.644742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfeb-092d-4281-a53e-c6ecaddcb073 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:51.645262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfeb-092d-4281-a53e-c6ecaddcb073 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:51.645262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4bfeb-092d-4281-a53e-c6ecaddcb073 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:51.646570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 581/1186] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:51.651609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ddb34-6704-4cde-bcec-638643243941 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:51.652053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ddb34-6704-4cde-bcec-638643243941 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:51.652155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ddb34-6704-4cde-bcec-638643243941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:51.670625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-418ddb34-6704-4cde-bcec-638643243941 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:51.671803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-418ddb34-6704-4cde-bcec-638643243941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:51.734965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 606/1187] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 16 01:42:51.999460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bfeb-092d-4281-a53e-c6ecaddcb073 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:52.103912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4bfeb-092d-4281-a53e-c6ecaddcb073 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:52.140561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:52.141192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:52.141472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:52.141746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:52.151534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:52.156346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:52.157263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:42:52.158223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 582/1188] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:52.163494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ddb34-6704-4cde-bcec-638643243941 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:52.259283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ddb34-6704-4cde-bcec-638643243941 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:52.275068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:52.296135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:52.296747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:52.297029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:52.297305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:52.298002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:52.298310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:52.299675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:52.307560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 607/1189] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:52.313355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:52.362108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:52.412417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ec2e88-cde2-4543-abf4-f65668a8f765 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:52.444820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:52.445443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:52.445732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:52.446036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] PATH_INFO: `/v3/users/924e307a4ffe4cc3821f678f36d3ad3d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:52.447152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] RBAC: Authorizing `identity:get_user(user_id=924e307a4ffe4cc3821f678f36d3ad3d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:52.448582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:52.450723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 583/1190] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:52 2022] GET /identity/v3/users/924e307a4ffe4cc3821f678f36d3ad3d => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:52.456642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:52.554870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb2ec73-dd88-4328-8fde-4d215f473beb None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:52.587118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:52.587740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:52.588021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:52.588295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] PATH_INFO: `/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:52.589396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] RBAC: Authorizing `identity:get_project(project_id=eb887eaf6d334fdfa1f41a9e11c6be9a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:52.591599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c8b50-c019-4a9a-a1ec-f1e4c05daa4e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:52.593214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 608/1191] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:52 2022] GET /identity/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:52.599270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:52.695308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63a600-9651-4dfb-a66c-fb1303f9d35e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:52.711532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:52.728989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:52.729640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:52.729961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:52.730238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] PATH_INFO: `/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a/users/924e307a4ffe4cc3821f678f36d3ad3d/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:52.732636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb887eaf6d334fdfa1f41a9e11c6be9a, user_id=924e307a4ffe4cc3821f678f36d3ad3d, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:52.734095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8bbca1-cbd6-426b-92a7-e32ca4f7d4b0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:52.747551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 584/1192] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:42:52 2022] PUT /identity/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a/users/924e307a4ffe4cc3821f678f36d3ad3d/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:42:54.864339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7cfa-2042-451f-a368-3b2d22be1283 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:54.865152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7cfa-2042-451f-a368-3b2d22be1283 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:54.865152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7cfa-2042-451f-a368-3b2d22be1283 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:54.866530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 609/1193] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:42:54.871809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:54.872249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:54.872369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:54.891993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:42:54.893180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:42:54.959993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 585/1194] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:42:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:42:55.228634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7cfa-2042-451f-a368-3b2d22be1283 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:55.274989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:55.331723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d7cfa-2042-451f-a368-3b2d22be1283 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:55.364747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:55.365369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:55.365650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:55.365956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:55.376119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:42:55.380826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:42:55.381935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:42:55.382990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 610/1195] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:42:55.388410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:55.487294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecc6f2-aed3-4f9b-a9df-85b0549aca95 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:55.494216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:55.521572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:55.522196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:55.522470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:55.522736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:55.523384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:55.523682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:55.525025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:55.533219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 586/1196] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:42:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:55.539072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:55.633009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db6efc9-54eb-4033-9e96-8c3cdb2736e0 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:55.635251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:55.666055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:55.666669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:55.666953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:55.667229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] PATH_INFO: `/v3/users/924e307a4ffe4cc3821f678f36d3ad3d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:55.668354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] RBAC: Authorizing `identity:get_user(user_id=924e307a4ffe4cc3821f678f36d3ad3d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:55.670458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:55.672007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 611/1197] 10.222.0.33 () {56 vars in 1177 bytes} [Fri Sep 16 01:42:55 2022] GET /identity/v3/users/924e307a4ffe4cc3821f678f36d3ad3d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:55.677660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:55.774217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452be8f1-2e52-40b6-aa84-0cf791f3a7b7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:55.806021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:55.806605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:55.806884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:55.807155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:55.839663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:55.871947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:55.873377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:55.966926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 587/1198] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:42:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:42:55.972761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:56.068427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa036fb3-2981-493f-bbb1-5e9709cee39d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:56.100637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:56.101243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:56.101524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:56.101798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] PATH_INFO: `/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:56.102924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] RBAC: Authorizing `identity:get_project(project_id=eb887eaf6d334fdfa1f41a9e11c6be9a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:56.104329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0c8d1f-024f-4371-b393-db06dd5bea0e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:56.106456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 612/1199] 10.222.0.33 () {56 vars in 1186 bytes} [Fri Sep 16 01:42:55 2022] GET /identity/v3/projects/eb887eaf6d334fdfa1f41a9e11c6be9a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:42:56.112310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:42:56.175920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:42:56.216076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4200f-652a-4218-9554-cef8bce168af None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:42:56.248563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:42:56.249159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:42:56.249439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:42:56.249712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:42:56.250449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=eb887eaf6d334fdfa1f41a9e11c6be9a, user.id=924e307a4ffe4cc3821f678f36d3ad3d) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:42:56.250758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:42:56.252185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d553c21-128f-46a2-8708-c2976774647e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:42:56.257768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 588/1200] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:42:56 2022] GET /identity/v3/role_assignments?user.id=924e307a4ffe4cc3821f678f36d3ad3d&scope.project.id=eb887eaf6d334fdfa1f41a9e11c6be9a&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:06.097063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=80 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:06.255242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=34 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:51.923873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d03a-3c57-4b54-8198-dbf06d8773ce None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:51.924720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d03a-3c57-4b54-8198-dbf06d8773ce None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:51.924720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5d03a-3c57-4b54-8198-dbf06d8773ce None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:51.925827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 613/1201] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:43:51.932317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:51.932996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:51.932996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:51.954007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:43:51.955322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:43:52.038916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 589/1202] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:43:52.321227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d03a-3c57-4b54-8198-dbf06d8773ce None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:52.448654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5d03a-3c57-4b54-8198-dbf06d8773ce None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:52.501683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:52.502625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:52.502855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:52.503241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:52.516161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:52.517651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:43:52.534441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:52.535551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:43:52.536529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:43:52.536529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:52.536529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:43:52.536529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 614/1203] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:43:52.544123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:52.662925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bac76-93b8-4e94-9301-3314ca085c6a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:52.707853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:52.716596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:52.717340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:52.717733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:52.718148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:52.718898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:52.719295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:52.720751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62269aed-b7af-4ba3-87dd-4e0e7988c483 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:52.739274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 590/1204] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:52.740363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:52.806121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:52.861199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44616d37-ee43-4728-bcb6-775426cb407b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:52.911020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:52.912013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:52.912517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:52.912961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:52.914003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:52.915668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b687aeb-2cba-4382-8bec-84ae3ac0680b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:52.953895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 615/1205] 10.222.0.33 () {60 vars in 1132 bytes} [Fri Sep 16 01:43:52 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:43:55.373815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54a59-8057-4cc8-9f26-a55222e542e5 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:55.373815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54a59-8057-4cc8-9f26-a55222e542e5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:55.373815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb54a59-8057-4cc8-9f26-a55222e542e5 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:55.374822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 591/1206] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:43:55.379373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:55.379801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:55.379936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:55.404685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:43:55.405924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:43:55.491704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 616/1207] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:43:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:43:55.768600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb54a59-8057-4cc8-9f26-a55222e542e5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:55.891988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb54a59-8057-4cc8-9f26-a55222e542e5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:55.938884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:55.939514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:55.939795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:55.940064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:55.953659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:43:55.961128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:55.967231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:43:55.969344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 592/1208] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:43:55.970205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:56.027741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:56.110454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8f7fe-1575-4fbb-ab8e-8face73f7862 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:56.152802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:56.153417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:56.153719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:56.154021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:56.154743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:56.154990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:56.156393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:56.166008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 617/1209] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:43:56.171991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:56.233920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:56.298899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32270c-dba1-43f2-b26a-6404ef17d9ff None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:56.335799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:56.336492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:56.336785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:56.337053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:56.349481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:56.351045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:43:56.367079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:56.368133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:43:56.369080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:43:56.369080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:56.369080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:43:56.370040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 593/1210] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:43:56.374465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:56.487096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:56.494502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74a1d16-ce5b-48f1-b9e7-0737ef07f652 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:56.536685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:56.537385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:56.537669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:56.537976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:56.538665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:56.538981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:56.540702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:56.554661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 618/1211] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:56.561562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:56.685724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f73567a-0a1a-4015-862e-e29026c57238 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:56.687568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:56.727342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:56.727967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:56.728785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:56.729340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:56.736741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:56.738660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:43:56.753801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:56.754937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:43:56.756163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 594/1212] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:43:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:43:56.763070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:56.910778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ef22f-d488-4c15-804c-def92c37390f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:56.948293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:56.948997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:56.949341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:56.949678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:56.950501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:56.952307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:56.952307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:56.972436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 619/1213] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:43:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:56.979105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:57.101376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff3c32-ea91-422b-915b-98dd439f1ffa None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:57.144282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:57.144893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:57.145173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:57.145444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:57.180395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:57.237665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:57.240490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:57.372032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 595/1214] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:43:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:43:57.378106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:57.399862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:57.502430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69504990-ccd5-42a1-8f8f-3cd47ae3f416 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:57.544706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:57.545343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:57.545617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:57.545910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:57.557146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:57.558646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:43:57.575293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:57.576505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:43:57.577637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:43:57.577637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:43:57.577637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:43:57.577637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 620/1215] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:43:57.582325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:57.671060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:57.716497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0186bf16-86ed-4194-815b-4200e6b5a76f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:57.754823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:57.755699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:57.756114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:57.756596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:57.757602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:57.758045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:57.760750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:57.780716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 596/1216] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:57.782993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:57.866516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:57.908393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102244b-d392-4bb4-afed-83f95174734f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:57.949234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:57.950117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:57.950407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:57.950685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:57.959984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:57.961695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:43:57.979485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:43:57.980639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:43:57.986529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 621/1217] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:43:57.988978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:58.106871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefeeab5-61e0-4466-b471-b3c1739bb2e6 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:58.131211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:58.144209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:58.144877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:58.145183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:58.145485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:58.146275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:58.146623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:58.148172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f77a83-82e6-49e5-9db8-f53158174693 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:58.161420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 597/1218] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:43:58.168250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:43:58.282830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b2855-f89a-4eed-ba5b-0d75ae71c0b9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:43:58.312187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:43:58.318581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:43:58.319185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:43:58.319466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:43:58.319740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:43:58.320490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=87b1d9cc1b0c482eae5661be121abb18) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:43:58.320801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:43:58.322249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69334c83-d9f9-41fa-aa86-7e9d06c34683 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:43:58.327938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 622/1219] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:43:58 2022] GET /identity/v3/role_assignments?user.id=87b1d9cc1b0c482eae5661be121abb18&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:44:00.548086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8178a3-1a1b-48a6-8c3b-f50c615db2f7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:00.548595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8178a3-1a1b-48a6-8c3b-f50c615db2f7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:00.548595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8178a3-1a1b-48a6-8c3b-f50c615db2f7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:00.550043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 598/1220] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:00.555561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:00.556009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:00.556167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:00.574986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:00.577113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:00.648940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 623/1221] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:00.914180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8178a3-1a1b-48a6-8c3b-f50c615db2f7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.047161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8178a3-1a1b-48a6-8c3b-f50c615db2f7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.089231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.089883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.090179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.090450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.101271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:44:01.106614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:01.108468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:01.109501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 599/1222] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:44:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:01.114197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.225489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259b76c-51ae-4284-bafc-e859b90b9848 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.255521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:01.269248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.269977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.270321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.270576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.271327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:01.271813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:01.273303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:01.285256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 624/1223] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:44:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:01.291150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.339838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:01.403193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4cf7-a6e5-4d42-a7a6-4e5e44672d5e None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.438395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.439021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.439300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.439572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.450181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:01.451643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:01.466153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:01.467693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:01.469343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:01.469343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:01.469343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:01.469343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 600/1224] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:01.473172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.578477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bb390-e377-408b-8852-dd437e888d64 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.614743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.615404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.615687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.615958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.616637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:01.616939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:01.618354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:01.629958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 625/1225] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:01.636196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.738462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:01.747203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d25691-36d3-4dee-a38d-36d8b8656a5f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.788858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.789409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.789710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.790024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.799309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:01.800782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:44:01.813370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:01.814571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:01.815703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 601/1226] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:01.820552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:01.876965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:01.939497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff9422b-d716-49ee-bfb1-a3ec14a3d5da None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:01.977222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:01.978377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:01.978699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:01.979021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:01.979910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:01.980268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:01.981938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.006109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 626/1227] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:44:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:02.012229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:02.116259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2c9ff-03de-4bdf-9afb-07b3be3fd638 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:02.153422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:02.154012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:02.154311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:02.154567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:02.167065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:02.168930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:02.185343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:02.186574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:02.187825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:02.187825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:02.187825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:02.187825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 602/1228] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:02.192596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:02.302946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79766f8f-f9ab-41f2-8ded-8f4e3ee2a96f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:02.305588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:02.342761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:02.343374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:02.343659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:02.343935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:02.344575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:02.344881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:02.346281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.358295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 627/1229] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:44:02.364645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:02.375485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:02.480053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b996596-cb2e-472a-be4d-ce0dfecfab6a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:02.520264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:02.520955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:02.521236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:02.521507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:02.529591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:02.531071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:44:02.543020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:02.544354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:02.545643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 603/1230] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:02.550186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:02.653524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b8818-27df-4614-9f03-01ee69a0f356 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:02.687168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:02.687919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:02.688205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:02.688478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:02.689169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:02.689478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:02.690969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541d01b-f391-46ad-9610-6a3ff6790c9b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.703828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 628/1231] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:02.709918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:02.779692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:02.815402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe23e1d-807b-4fe6-a9d1-11f4ab6f6ff0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:02.849359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:02.850088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:02.850373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:02.850648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/87b1d9cc1b0c482eae5661be121abb18/roles/373ac7df61944c6faf83261472dea47b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:02.865342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=87b1d9cc1b0c482eae5661be121abb18, role_id=373ac7df61944c6faf83261472dea47b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:02.866820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87478e-4756-43b0-b18c-4abe6ffa1bdd None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:02.880001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 604/1232] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:44:02 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/87b1d9cc1b0c482eae5661be121abb18/roles/373ac7df61944c6faf83261472dea47b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:44:05.218583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444aa3b-37d7-4912-acfd-157ce9ee5f22 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:05.219260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444aa3b-37d7-4912-acfd-157ce9ee5f22 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:05.219260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444aa3b-37d7-4912-acfd-157ce9ee5f22 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:05.220467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 629/1233] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:05.226223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:05.226748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:05.226748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:05.245780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:05.246999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:05.328170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 605/1234] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:05.619464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444aa3b-37d7-4912-acfd-157ce9ee5f22 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:05.648951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:05.736334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444aa3b-37d7-4912-acfd-157ce9ee5f22 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:05.776461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:05.777407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:05.777698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:05.778080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:05.789980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:44:05.795505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:05.796580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:05.797554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 630/1235] 10.222.0.33 () {56 vars in 1102 bytes} [Fri Sep 16 01:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:05.804631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:05.856402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:05.918423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba158b82-bfd6-4aec-831e-0dafec8e670a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:05.958348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:05.959129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:05.959496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:05.959772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:05.964671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] RBAC: Adding query filter params (name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:05.966050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:05.967770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:05.979079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 606/1236] 10.222.0.33 () {56 vars in 1103 bytes} [Fri Sep 16 01:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:44:05.985072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:06.081982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:06.100378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c4f73-87ba-4390-901a-251e1601eed9 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:06.135424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:06.136080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:06.136324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:06.136593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:06.147389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:06.148809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:06.163367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:06.164772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:06.166416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:06.166416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:06.166416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:06.166416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 631/1237] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:06.171004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:06.280775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c15df8-b21c-47af-8589-123d8711a179 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:06.292464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:06.320773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:06.321385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:06.321695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:06.321993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:06.322637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:06.322992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:06.324314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:06.337806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 607/1238] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:06.344399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:06.450957 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21feacb0-8980-4934-bee6-10792daeecfc None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:06.489098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:06.489724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:06.490039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:06.490310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:06.493569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:06.499471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:06.501492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:44:06.515409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:06.516474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:06.517557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 632/1239] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:06.523525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:06.631048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81c638-3cbc-401e-84b3-6c028e42beea None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:06.668251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:06.668849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:06.669127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:06.669392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:06.670133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:06.670434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:06.671852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:06.690296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 608/1240] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:44:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:06.696965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:06.807193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d8f17e-f4ea-4619-be62-959eddad746f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:06.841596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:06.842229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:06.842504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:06.842807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:06.911649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:06.919568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:06.921028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.040828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 633/1241] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:44:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:44:07.046824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:07.077709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:07.164515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3568a063-91ec-4138-ba3f-3bd0e79a80a1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:07.201263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:07.202035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:07.202322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:07.203043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:07.215068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:07.216785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:07.233755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:07.235091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:07.236185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:07.236185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:07.236185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:07.236185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 609/1242] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:07.241275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:07.353539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:07.360831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae697a-6c02-4344-84f8-90b1a84350db None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:07.403406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:07.404188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:07.404613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:07.404895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:07.405683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:07.406092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:07.407964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.426836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 634/1243] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:07.428662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:07.522347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:07.549192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc44bd82-3e44-4190-ae51-d1d31e56e343 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:07.588202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:07.588920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:07.589225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:07.589653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:07.596718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:07.598235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:44:07.612061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:07.613063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:07.614184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 610/1244] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:07.619644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:07.732475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5157ccee-1c31-47f5-a26e-f9e8bddfde98 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:07.771189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:07.771793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:07.772720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:07.773007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:07.773734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:07.774101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:07.776299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2499722-3b6d-4212-b7d2-07e137354c30 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.788758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 635/1245] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:07.795557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:07.914076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58060be6-099d-4201-b57e-7e15f25851ac None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:07.949700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:07.950431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:07.950726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:07.951035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:07.951855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] RBAC: Adding query filter params (role.id=373ac7df61944c6faf83261472dea47b, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=87b1d9cc1b0c482eae5661be121abb18) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:07.952250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:07.953993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea2086-af4f-4afe-b8e3-0cef5751a425 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:07.973898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 611/1246] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:44:07 2022] GET /identity/v3/role_assignments?user.id=87b1d9cc1b0c482eae5661be121abb18&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=373ac7df61944c6faf83261472dea47b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:10.256726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ee12-02d9-4337-afa2-ca0f3ec643b1 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:10.257442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ee12-02d9-4337-afa2-ca0f3ec643b1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:10.257442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295ee12-02d9-4337-afa2-ca0f3ec643b1 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:10.258708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 636/1247] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:10.264850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:10.265354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:10.265655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:10.273307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:10.289136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:10.290396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:10.373218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 612/1248] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:10.643489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ee12-02d9-4337-afa2-ca0f3ec643b1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:10.662339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:10.751435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295ee12-02d9-4337-afa2-ca0f3ec643b1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:10.794477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:10.795134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:10.795421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:10.795703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:10.806737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:44:10.811693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:10.813032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:10.814552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 637/1249] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:10.819633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:10.930890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662ec21-76f6-41f9-816e-ac709f7ca34f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:10.961020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:10.967936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:10.968601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:10.968884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:10.969272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:10.969946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:10.970262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:10.971713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:10.981911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 613/1250] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:10.988208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:11.072941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:11.097707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd9e1d-8361-4213-9344-c338b00e70e0 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:11.141160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:11.141845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:11.142150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:11.142362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:11.155563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:11.157192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:11.174513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:11.175556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:11.176474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:11.176474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:11.176474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:11.176474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 638/1251] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:11.182673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:11.299404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0b39b-5deb-4b00-ba31-0b40226fbacc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:11.338886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:11.339602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:11.339880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:11.340151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:11.340784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:11.341216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:11.342772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:11.354722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 614/1252] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:11.360484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:11.469187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db8144-80eb-4bfc-a252-8ead054a8476 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:11.498246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:11.507150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:11.507807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:11.508093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:11.508372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:11.517455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:11.518943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:44:11.531729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:11.532840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:11.533832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 639/1253] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:11.539018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:11.596973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:11.644540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b974d0-3981-4085-bbe6-9762c6cff29a None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:11.681349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:11.682010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:11.682295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:11.682567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:11.683308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:11.683613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:11.685075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:11.703797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 615/1254] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:44:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:44:11.709617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:11.815234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5731e1-bacd-4ef4-95d9-f3760aabf34d None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:11.849884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:11.850520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:11.850799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:11.851072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:11.912552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:11.927020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:11.928466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.034509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 640/1255] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:44:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:44:12.040612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:12.142029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414d2640-f49b-465b-9b81-188d766c8651 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:12.155830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:12.177180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:12.177805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:12.178137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:12.178407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:12.188580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:12.190402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:12.205748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:12.207116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:12.208486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:12.208486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:12.208486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:12.208486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 616/1256] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:12.213123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:12.295993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:12.308547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0262ec-a94a-4718-8629-00b7898c2863 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:12.340728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:12.341322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:12.341598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:12.341897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:12.342517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:12.342816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:12.344147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.354791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 641/1257] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:12.360399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:12.459087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52524485-11dc-461f-968a-3631ad92f828 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:12.493757 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:12.494447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:12.494726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:12.494996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:12.501384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:12.502832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:44:12.516236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:12.517303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:12.518617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 617/1258] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:44:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:12.523209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:12.621839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02245632-ea88-4a77-8c7b-902c223eee22 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:12.654116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:12.654702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:12.654981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:12.655251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:12.655924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:12.656226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:12.657627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b1f443-01d5-4f3d-8c7d-c556dcd63c2e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.669483 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 642/1259] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:44:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:12.675231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:12.700401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:12.773304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbe7f54-b55a-4d7c-b137-57f14793baf0 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:12.805763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:12.806377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:12.806660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:12.806931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:12.807634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=87b1d9cc1b0c482eae5661be121abb18) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:12.807936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:12.809352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245625d5-7aad-4395-bd37-e2935d08d32e None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:12.814557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 618/1260] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:44:12 2022] GET /identity/v3/role_assignments?user.id=87b1d9cc1b0c482eae5661be121abb18&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:14.916334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda0a85-e006-432d-93f7-126def745040 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:14.916870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda0a85-e006-432d-93f7-126def745040 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:14.916870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda0a85-e006-432d-93f7-126def745040 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:14.918259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 643/1261] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:14.923268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:14.923683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:14.923819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:14.941579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:14.942783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:15.019127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 619/1262] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:15.289906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda0a85-e006-432d-93f7-126def745040 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:15.300714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:15.389782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda0a85-e006-432d-93f7-126def745040 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:15.423489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:15.432195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:15.432477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:15.432750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:15.443602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:44:15.448391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:15.449469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:15.450617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 644/1263] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:44:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:15.455449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:15.473577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:15.552394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae052658-5477-4cb2-a1aa-dd65794d6d30 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:15.585765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:15.586392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:15.586689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:15.586964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:15.587622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:15.587926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:15.589284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:15.596970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 620/1264] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:44:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:15.602734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:15.667363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:15.699200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49a06e-e6cf-4c00-a2d0-aa4391efab0e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:15.731484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:15.732095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:15.732376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:15.732651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:15.742218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:15.744221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:15.758226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:15.759323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:15.760555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:15.760555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:15.760555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:15.760555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 645/1265] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 16 01:44:15.765213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:15.842441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:15.861565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599539c2-ab63-4987-bf84-e491e2746623 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:15.894292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:15.894879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:15.895158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:15.895430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:15.896052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:15.896352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:15.897694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:15.909526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 621/1266] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:15.915563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.014548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450e22e5-30ec-4c4a-92e4-4bf7ef0faa73 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.033559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:16.047832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.048453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.048735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.049010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.056116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.057534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:44:16.068260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:16.069360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:16.070537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 646/1267] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:16.075190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.171733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49a01f8-7c53-4020-b392-0a99c30f6dd7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.204751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.205338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.205613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.205907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.206614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:16.206913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.208320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.217387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:16.225802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 622/1268] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:44:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:16.232037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.328438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1633b37-d246-4cc6-9080-2795ebe79473 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.361096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.361710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.362019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.362297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.372376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.373797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:16.387867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:16.389248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:16.390202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:16.390202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:16.390202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:16.390202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 647/1269] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:16.394928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.490728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2033eb7c-8109-458d-a89b-4f43753a4e97 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.523423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.524013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.524836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.525106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.525728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:16.526057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.527403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.538111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 623/1270] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:16.543675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.575158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:16.641359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee4830-68bc-407f-a2cb-a324cd49689e None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.673649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.674292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.674575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.674850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.681277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.682721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:44:16.693581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:16.694659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:16.695595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 648/1271] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:16.700937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.757463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:16.797971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14647633-7278-4524-979f-6ff76bc0d4dc None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.830728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.831317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.831599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.831873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.832548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:16.832852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.834300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5001ea-9b31-4240-a892-b7bc70229926 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:16.845734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 624/1272] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:16.851517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:16.938235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:16.947666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3892fd-ea27-43db-8305-8db56a8d7b9f None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:16.986875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:16.987664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:16.988018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:16.988343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] PATH_INFO: `/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/87b1d9cc1b0c482eae5661be121abb18/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:16.990538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] RBAC: Authorizing `identity:create_grant(project_id=4d918f5b6b3647b3b76ae72215ad9817, user_id=87b1d9cc1b0c482eae5661be121abb18, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:16.991954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fa2ee-51bd-4bd1-a421-080d6eb7d0ab None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:17.004325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 649/1273] 10.222.0.33 () {58 vars in 1439 bytes} [Fri Sep 16 01:44:16 2022] PUT /identity/v3/projects/4d918f5b6b3647b3b76ae72215ad9817/users/87b1d9cc1b0c482eae5661be121abb18/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:44:19.103410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2650b5-c01e-47a0-894b-ce72c7c1ef9c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:19.103964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2650b5-c01e-47a0-894b-ce72c7c1ef9c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:19.103964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2650b5-c01e-47a0-894b-ce72c7c1ef9c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:19.105281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 625/1274] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:19.110413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:19.110876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:19.110989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:19.132159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:19.132159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:19.199914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 650/1275] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:19.471466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2650b5-c01e-47a0-894b-ce72c7c1ef9c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:19.571912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2650b5-c01e-47a0-894b-ce72c7c1ef9c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:19.589070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:19.605892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:19.606535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:19.606817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:19.607090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:19.616856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 16 01:44:19.622316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:19.623583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:19.624771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 626/1276] 10.222.0.33 () {56 vars in 1096 bytes} [Fri Sep 16 01:44:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:19.629489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:19.710421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:19.729559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb86a-08ab-4a3e-9c26-de9eab41d77d None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:19.761945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:19.762545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:19.762827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:19.763363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:19.764024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:19.764330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:19.765688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:19.774745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 651/1277] 10.222.0.33 () {56 vars in 1099 bytes} [Fri Sep 16 01:44:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:19.780647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:19.878366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd1eeb-879d-4c80-9b71-7e0f7a2172e7 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:19.911163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:19.911781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:19.912061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:19.912333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:19.921885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:19.923325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:19.937796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:19.938850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:19.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:19.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:19.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:19.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 627/1278] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:19.944597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.053073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332ff78-c5b1-4787-be37-e1657db8f703 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:20.086332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:20.086990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:20.087273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:20.087550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:20.088346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:20.088683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:20.090081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:20.102062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 652/1279] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:20.108001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.141151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:20.209589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44827a39-085b-4f7d-8c60-7cd06521d048 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:20.243845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:20.244466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:20.244764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:20.245071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:20.252576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:20.254039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 16 01:44:20.266405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:20.267346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:20.268355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 628/1280] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:20.273780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.278488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:20.372839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a0fbd1-1619-445a-8f88-4980333dc3e8 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:20.408910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:20.409517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:20.409797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:20.410154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:20.410829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:20.411135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:20.412970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:20.430124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 653/1281] 10.222.0.33 () {56 vars in 1143 bytes} [Fri Sep 16 01:44:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:20.435945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.525085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:20.534417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec320d9-d8dc-4470-853e-1128458272ec None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:20.566749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:20.567348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:20.567630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:20.567905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:20.632273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:20.633678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:20.719873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:20.730814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 629/1282] 10.222.0.33 () {58 vars in 1282 bytes} [Fri Sep 16 01:44:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 16 01:44:20.736695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.796390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:20.834257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c26b0-c38e-40f9-9b6c-d16ba495db3b None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:20.867768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:20.868384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:20.868668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:20.868947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:20.878691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:20.880120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 16 01:44:20.895079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:20.896206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 16 01:44:20.897316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 16 01:44:20.897316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 16 01:44:20.897316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:20.897316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 654/1283] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:20.901711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:20.998348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6c9dd-3f82-4ed5-a07b-77435f1c47de None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:21.031961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:21.032559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:21.032837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:21.033114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:21.033744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:21.034075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:21.035437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:21.047186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 630/1284] 10.222.0.33 () {56 vars in 1109 bytes} [Fri Sep 16 01:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:44:21.052939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:21.148884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3275c-b8d7-472f-9943-4bf865018cb1 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:21.161703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:21.182059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:21.182666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:21.182949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:21.183219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:21.189538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:21.190984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 16 01:44:21.201832 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:21.202979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: ERROR keystone.server.flask.application Sep 16 01:44:21.204107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 655/1285] 10.222.0.33 () {56 vars in 1111 bytes} [Fri Sep 16 01:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:21.208685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:21.257095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:21.306389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8fcd0-efb6-42a3-8cbe-c05002e6800f None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:21.338542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:21.339138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:21.339417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:21.339690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:21.340368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:21.340674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:21.342111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85e8fd-8a11-44f9-9bcc-fa65ca7670cf None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:21.354072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 631/1286] 10.222.0.33 () {56 vars in 1148 bytes} [Fri Sep 16 01:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:21.360021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:21.454778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddcea4-9e8d-49c5-9fbb-b9528523dd5a None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:21.486983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:21.487565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:21.487844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:21.488113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:21.488818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] RBAC: Adding query filter params (role.id=1e8d49b29f0b4d74819627a73b17767f, scope.project.id=4d918f5b6b3647b3b76ae72215ad9817, user.id=87b1d9cc1b0c482eae5661be121abb18) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:21.489125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:21.490583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547c201-11b3-494f-ae21-baa5e344b8de None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:21.496056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 656/1287] 10.222.0.33 () {56 vars in 1374 bytes} [Fri Sep 16 01:44:21 2022] GET /identity/v3/role_assignments?user.id=87b1d9cc1b0c482eae5661be121abb18&scope.project.id=4d918f5b6b3647b3b76ae72215ad9817&role.id=1e8d49b29f0b4d74819627a73b17767f => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:23.615350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d6c83-d087-427c-af06-0cd7642e6fa7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:23.615858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d6c83-d087-427c-af06-0cd7642e6fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:23.615858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d6c83-d087-427c-af06-0cd7642e6fa7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:23.617119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 632/1288] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:23.622680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:23.623149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:23.623252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:23.641956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:23.643138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:23.671264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:23.709291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 657/1289] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:23.974625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d6c83-d087-427c-af06-0cd7642e6fa7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:24.085136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d6c83-d087-427c-af06-0cd7642e6fa7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:24.095328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:24.118874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:24.119495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:24.119772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:24.120043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:24.120617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:24.122013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:24.130596 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:24.131771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:24.132658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 633/1290] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:44:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:24.137649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:24.232290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c72987f-ebd2-4479-93c4-e0f7d610380e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:24.265220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:24.265812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:24.266119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:24.266390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:24.267006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:24.267304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:24.268650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96ff7f-a7cf-40df-ab89-233754f7318b None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:24.273594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 658/1291] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 01:44:24 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:24.279142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:24.375320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a35e-ecc4-4efe-ae02-078894100fe3 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:24.407883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:24.408471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:24.408752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:24.409026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] PATH_INFO: `/v3/services` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:24.409644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] RBAC: Adding query filter params (type=placement) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:24.409975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:24.411326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4aee59-cec8-4867-9ecc-8b6a1819457d None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:24.415616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 634/1292] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 01:44:24 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:26.522293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361f9da-e56b-453c-9c49-453eb168cf86 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:26.522803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361f9da-e56b-453c-9c49-453eb168cf86 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:26.522803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361f9da-e56b-453c-9c49-453eb168cf86 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:26.524144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 659/1293] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:26.529321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada974-4ebd-4813-ab27-d76f73c037af None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:26.529752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada974-4ebd-4813-ab27-d76f73c037af None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:26.529904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ada974-4ebd-4813-ab27-d76f73c037af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:26.547577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-69ada974-4ebd-4813-ab27-d76f73c037af None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:26.548751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-69ada974-4ebd-4813-ab27-d76f73c037af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:26.577843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:26.620425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 635/1294] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:26.892090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361f9da-e56b-453c-9c49-453eb168cf86 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:26.923822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:26.996273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361f9da-e56b-453c-9c49-453eb168cf86 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:27.031356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:27.031956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:27.032233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:27.032522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:27.033173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:27.034579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a434478-5521-43cb-b760-11ce24ab4724 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:27.047867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 660/1295] 10.222.0.33 () {60 vars in 1141 bytes} [Fri Sep 16 01:44:26 2022] POST /identity/v3/services => generated 246 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:44:29.187659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856cbd-bf90-4d79-98d3-1c04fd33ec51 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:29.188229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856cbd-bf90-4d79-98d3-1c04fd33ec51 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:29.188229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3856cbd-bf90-4d79-98d3-1c04fd33ec51 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:29.189550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 636/1296] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:29.194701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:29.195094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:29.195275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:29.212876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:29.214085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:29.283690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 661/1297] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:29 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:29.548172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856cbd-bf90-4d79-98d3-1c04fd33ec51 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:29.646739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3856cbd-bf90-4d79-98d3-1c04fd33ec51 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:29.678339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:29.678947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:29.679225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:29.679493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:29.680561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:29.681934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:29.690345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:29.691503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:29.692550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 637/1298] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:44:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:29.697894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:29.715385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:29.792384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f212c15-cb96-45bc-a735-01bc6efb4bdc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:29.825123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:29.825664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:29.825966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:29.826243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:29.826861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:29.827164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:29.828508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:29.833394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 662/1299] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 01:44:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:29.839406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:29.871159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:29.938282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301567c-f5a8-4d1c-9c1f-ddb53132c4f2 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:29.976008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:29.976650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:29.977493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:29.977758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:29.978559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] RBAC: Adding query filter params (interface=public, service_id=90dd0169debd4bc68b818d8d4b262a22, region_id=RegionOne) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:29.978909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:29.980590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4e8c7-caf2-431b-be8e-cdc0e1eaabd9 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:29.986809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 638/1300] 10.222.0.33 () {56 vars in 1251 bytes} [Fri Sep 16 01:44:29 2022] GET /identity/v3/endpoints?service_id=90dd0169debd4bc68b818d8d4b262a22&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:29.993244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:30.074482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:30.091631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a2976-6d17-46c1-80b5-6b81cdca2646 None admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:30.124098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:30.124689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:30.124968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:30.125239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:30.125824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:30.127197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d803-1178-4683-b8bc-a36feac90551 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:30.133720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 663/1301] 10.222.0.33 () {56 vars in 1087 bytes} [Fri Sep 16 01:44:29 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:44:32.231520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824924e-ac0b-4930-89a7-e50f3cd9df94 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:32.232090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824924e-ac0b-4930-89a7-e50f3cd9df94 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:32.232090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824924e-ac0b-4930-89a7-e50f3cd9df94 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:32.233394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 639/1302] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:44:32.238604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:32.239046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:32.239140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:32.257282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:44:32.258511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:44:32.323250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 664/1303] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:44:32 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 16 01:44:32.589271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824924e-ac0b-4930-89a7-e50f3cd9df94 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:32.681426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:32.688475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824924e-ac0b-4930-89a7-e50f3cd9df94 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:32.720655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:32.721268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:32.721542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:32.721807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:32.722401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:32.723749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 16 01:44:32.732746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 16 01:44:32.733925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.get_or_create( Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application with Lock( Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self._enter() Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application return self.creator() Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application created_value = creator( Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: ERROR keystone.server.flask.application Sep 16 01:44:32.735275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 640/1304] 10.222.0.33 () {56 vars in 1117 bytes} [Fri Sep 16 01:44:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 16 01:44:32.739716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:32.812199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:32.834261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb25ef-391b-428b-971c-897e0472c99b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:32.867225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:32.867771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:32.868053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:32.868327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] PATH_INFO: `/v3/services` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:32.868949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:44:32.869252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:32.870631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac4efa-aa71-424d-9382-4bf587c9d011 None admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:32.875529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 665/1305] 10.222.0.33 () {56 vars in 1116 bytes} [Fri Sep 16 01:44:32 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:44:32.881267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:44:32.981982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7780ba0-af1e-4247-8356-d2f09eac8fb1 None admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:44:33.014870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:44:33.015464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:44:33.015743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:44:33.016015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:44:33.016683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:44:33.018069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b0e63-af3b-412c-83f4-83a93b4fb0b0 None admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:44:33.036251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 641/1306] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:44:32 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:44:42.873048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=30 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:44:43.032106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:36.709402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19949e-d062-4ef0-9f9d-60d3a5aa1314 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:36.709840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19949e-d062-4ef0-9f9d-60d3a5aa1314 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:36.710036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e19949e-d062-4ef0-9f9d-60d3a5aa1314 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:36.715048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 666/1307] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:36.717628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b012-d036-4e4f-b30e-04502498cc31 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:36.718531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b012-d036-4e4f-b30e-04502498cc31 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:36.719027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c8b012-d036-4e4f-b30e-04502498cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:36.803870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e1c8b012-d036-4e4f-b30e-04502498cc31 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:36.806365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e1c8b012-d036-4e4f-b30e-04502498cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:36.967074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 642/1308] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:37.273489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:37.273489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:37.273489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:37.279040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 667/1309] 10.222.0.33 () {54 vars in 965 bytes} [Fri Sep 16 01:45:37 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:37.285338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301d1c-88f0-46d8-99f3-d772db53dd02 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:37.286837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301d1c-88f0-46d8-99f3-d772db53dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:37.287034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79301d1c-88f0-46d8-99f3-d772db53dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:37.369612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-79301d1c-88f0-46d8-99f3-d772db53dd02 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:37.371011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-79301d1c-88f0-46d8-99f3-d772db53dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:37.392938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:37.452378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 643/1310] 10.222.0.33 () {58 vars in 1062 bytes} [Fri Sep 16 01:45:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:37.462223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:37.464042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:37.594128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7ce08f-5cb7-4dce-ab9c-d35d617a1349 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:37.689631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:37.690269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:37.690546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:37.690880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:37.692494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:37.755163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:37.815252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:37.816811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4974644e-a1e2-4024-922b-96e186f3ffae service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:37.837466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 668/1311] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:45:40.285298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:40.285783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:40.286101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:40.287274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 644/1312] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:40.293277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32366-979b-4e02-8867-d5af10b1c85d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:40.293724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32366-979b-4e02-8867-d5af10b1c85d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:40.294054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac32366-979b-4e02-8867-d5af10b1c85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:40.373985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8ac32366-979b-4e02-8867-d5af10b1c85d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:40.375172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8ac32366-979b-4e02-8867-d5af10b1c85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:40.469523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 669/1313] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:45:40.748600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:40.750227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:40.853205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a200b3-e9b4-45c5-b715-b6c53642082d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:40.925208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:40.928196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:40.929237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:40.929751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:40.930375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:40.932416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:41.040566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:41.042030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752a43f-8c6c-4f07-8d54-7203427fc679 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:41.062021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 645/1314] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:45:43.540173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:43.540725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:43.540725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:43.542032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 670/1315] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:43.547341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62d7c-ee4b-41cc-a404-66d29428ef00 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:43.547752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62d7c-ee4b-41cc-a404-66d29428ef00 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:43.547889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62d7c-ee4b-41cc-a404-66d29428ef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:43.612033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fbd62d7c-ee4b-41cc-a404-66d29428ef00 None None] MFA Rules not processed for user `e62d6fa6d30e4862901cd65d25e63ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:43.613234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fbd62d7c-ee4b-41cc-a404-66d29428ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:43.664393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:43.708485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 646/1316] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:43.994940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:43.996489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:44.006780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:44.098637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276c2d4-23cf-482f-b9f4-fa777acd826e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:44.170861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:44.171462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:44.171742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:44.172014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:44.173848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:44.234647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:44.282424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:44.283856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42c875d-77e9-4d4d-ad1a-bca45cb556e0 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:44.303714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 671/1317] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:43 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:45:46.979446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:46.980024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:46.980024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:46.981327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 647/1318] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:46.986584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35c17-fefc-4aa9-99fc-6c8b32486f78 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:46.986976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35c17-fefc-4aa9-99fc-6c8b32486f78 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:46.987142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb35c17-fefc-4aa9-99fc-6c8b32486f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:47.052049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7eb35c17-fefc-4aa9-99fc-6c8b32486f78 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:47.053248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7eb35c17-fefc-4aa9-99fc-6c8b32486f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:47.151311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 672/1319] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:47.435880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:47.437425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:47.537319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae821e45-909e-41d8-a1b8-65168b8fff69 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:47.607263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:47.607853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:47.608128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:47.608396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:47.609967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:47.617118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:47.716118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:47.717549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc0349-4e08-4082-a9e8-a54f29b81227 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:47.735756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 648/1320] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:45:50.509531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b4715-d7f2-4efc-9427-0f7ddda9a782 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:50.510100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b4715-d7f2-4efc-9427-0f7ddda9a782 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:50.510100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b4715-d7f2-4efc-9427-0f7ddda9a782 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:50.511618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 673/1321] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:50.516847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c821-2ada-457e-a5b6-ee958a87f481 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:50.517279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c821-2ada-457e-a5b6-ee958a87f481 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:50.517394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5c821-2ada-457e-a5b6-ee958a87f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:50.589649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-12b5c821-2ada-457e-a5b6-ee958a87f481 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:50.590927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-12b5c821-2ada-457e-a5b6-ee958a87f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:50.652643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:50.696075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 649/1322] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:45:50.990116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:50.990403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:50.990675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:50.992069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 674/1323] 10.222.0.33 () {54 vars in 965 bytes} [Fri Sep 16 01:45:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:50.998214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ddf1-3ffa-4c6c-9699-cfa8c2b2d005 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:50.998507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ddf1-3ffa-4c6c-9699-cfa8c2b2d005 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:50.998782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2ddf1-3ffa-4c6c-9699-cfa8c2b2d005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:51.074867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a7e2ddf1-3ffa-4c6c-9699-cfa8c2b2d005 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:51.076066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a7e2ddf1-3ffa-4c6c-9699-cfa8c2b2d005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:51.149029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 650/1324] 10.222.0.33 () {58 vars in 1062 bytes} [Fri Sep 16 01:45:50 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:51.158086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:51.159919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:51.180921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:51.266589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43936a3-a5c2-4bc6-9768-815787837b99 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:51.341476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:51.342200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:51.342482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:51.342760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:51.344372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:51.416102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:51.454253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:51.455695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b00073-8966-4aab-a857-0dbe4db0dd3f service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:51.474573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 675/1325] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:45:53.935872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:53.936388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:53.936388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:53.937659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 651/1326] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:53.943366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de60ec-7b9c-411d-b63c-1bbb6e0f2678 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:53.943833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de60ec-7b9c-411d-b63c-1bbb6e0f2678 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:53.943931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de60ec-7b9c-411d-b63c-1bbb6e0f2678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:54.012016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b6de60ec-7b9c-411d-b63c-1bbb6e0f2678 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:54.013512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b6de60ec-7b9c-411d-b63c-1bbb6e0f2678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:54.109326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 676/1327] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:45:54.391806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:54.393397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:54.455159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:54.498036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f0158-59a4-4966-a8c1-2aa15b9cb894 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:54.571279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:54.571886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:54.572164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:54.572431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:54.574047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:54.681851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:54.684258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:54.686437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa514034-9532-45ab-91ab-4e9d263653ce service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:54.705476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 652/1328] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:45:56.925288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:56.925916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:56.925916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:56.927748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 677/1329] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:45:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:45:56.933433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043daee-6f54-42c3-a3a7-85baaa71c8dd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:56.933931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043daee-6f54-42c3-a3a7-85baaa71c8dd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:56.934030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043daee-6f54-42c3-a3a7-85baaa71c8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:57.003592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9043daee-6f54-42c3-a3a7-85baaa71c8dd None None] MFA Rules not processed for user `e62d6fa6d30e4862901cd65d25e63ede`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:45:57.005486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9043daee-6f54-42c3-a3a7-85baaa71c8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:57.105163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 653/1330] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:45:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:45:57.385011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:45:57.386601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:57.418448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:57.489740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d23ab-e0a2-4a8a-a5ee-c70013104c75 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:45:57.568814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:45:57.569425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:45:57.569706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:45:57.570041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:45:57.571635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:45:57.649514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:45:57.682702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:45:57.684152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9d7c5-ad52-4ca1-abd6-e11955084b50 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:45:57.702619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 678/1331] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:45:57 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:00.068428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:00.069002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:00.069002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:00.070344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 654/1332] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:00.075495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f66-a5ae-4635-9635-1e6d68492220 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:00.075896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f66-a5ae-4635-9635-1e6d68492220 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:00.076061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c4f66-a5ae-4635-9635-1e6d68492220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:00.142273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bd1c4f66-a5ae-4635-9635-1e6d68492220 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:00.143481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bd1c4f66-a5ae-4635-9635-1e6d68492220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:00.238666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 679/1333] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:00.517058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:00.518656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:00.586516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:00.619746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910f3f8-a6e0-4002-8a30-029c761f222c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:00.690896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:00.691516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:00.691792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:00.692061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:00.693623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:00.799723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:00.801694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557bc02c-b0dc-4d00-ba3d-c2448dd49a55 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:00.811434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:00.819940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 655/1334] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:02.974446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:02.974861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:02.975034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:02.976380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 680/1335] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:02.981601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538128e-1a72-4d54-8640-876400dbc0b8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:02.982088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538128e-1a72-4d54-8640-876400dbc0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:02.982184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b538128e-1a72-4d54-8640-876400dbc0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:03.045950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b538128e-1a72-4d54-8640-876400dbc0b8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:03.047137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b538128e-1a72-4d54-8640-876400dbc0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:03.141352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 656/1336] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:03.430237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:03.432031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:03.477011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:03.540694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aba691d-1c21-40ed-a35e-31302504bfda None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:03.611970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:03.612574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:03.612878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:03.613649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:03.615265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:03.696538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:03.722954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:03.724392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abc989-d5dd-4a7f-a758-f93025e95a8d service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:03.742597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 681/1337] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:06.183571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:06.184220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:06.184220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:06.185493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 657/1338] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:06.190756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a2b4-718b-42c7-bda6-50bb50066067 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:06.191699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a2b4-718b-42c7-bda6-50bb50066067 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:06.191888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839a2b4-718b-42c7-bda6-50bb50066067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:06.257294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2839a2b4-718b-42c7-bda6-50bb50066067 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:06.261472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2839a2b4-718b-42c7-bda6-50bb50066067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:06.353916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 682/1339] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:46:06.633229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:06.634817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:06.710322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:06.741577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a75169f-64b6-4a50-a725-61e3cccde2ff None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:06.812873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:06.813468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:06.813746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:06.814041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:06.815606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:06.931961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:06.933465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3cc42-0d7d-4ab1-877f-8a2ae8d538a2 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:06.951845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 658/1340] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:10.952946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:10.953559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:10.953559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:10.955057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 683/1341] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:10.960707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e0c8-5a3c-43ca-b94d-8d4fdf3be14b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:10.961147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e0c8-5a3c-43ca-b94d-8d4fdf3be14b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:10.961315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8e0c8-5a3c-43ca-b94d-8d4fdf3be14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:10.966832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:11.039067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-83b8e0c8-5a3c-43ca-b94d-8d4fdf3be14b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:11.040448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-83b8e0c8-5a3c-43ca-b94d-8d4fdf3be14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:11.145858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 659/1342] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:11.429519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:11.431093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:11.479254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:11.534364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8fd25-9371-4bc8-839d-89ce024bec22 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:11.607648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:11.608251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:11.608528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:11.608796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:11.610390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:11.700742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:11.717810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:11.719273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d359fa9-57c1-4078-bf47-7c1f7884352c service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:11.737492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 684/1343] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:14.543027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:14.543598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:14.543598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:14.544901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 660/1344] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:14.550590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe651-e322-4868-9110-d70c10c1f662 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:14.550992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe651-e322-4868-9110-d70c10c1f662 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:14.551277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebe651-e322-4868-9110-d70c10c1f662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:14.617472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c5ebe651-e322-4868-9110-d70c10c1f662 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:14.618690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c5ebe651-e322-4868-9110-d70c10c1f662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:14.716616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 685/1345] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:15.007432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:15.009021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:15.103856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:15.121088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab3e7ff-9b39-4f6c-8c37-7114a05c289c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:15.194608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:15.195152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:15.195419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:15.195692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:15.197283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:15.312845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:15.314371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a811240-a581-499e-b45f-806d5df9e8ee service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:15.332753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 661/1346] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:46:19.443816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:19.444275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:19.444366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:19.445715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 686/1347] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:19.450992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ed8b-f203-4535-ac65-b99ba8cdb3b3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:19.451386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ed8b-f203-4535-ac65-b99ba8cdb3b3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:19.451509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ed8b-f203-4535-ac65-b99ba8cdb3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:19.467146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:19.517846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e3c6ed8b-f203-4535-ac65-b99ba8cdb3b3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:19.519095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e3c6ed8b-f203-4535-ac65-b99ba8cdb3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:19.613314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 662/1348] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:19.894275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:19.895825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:19.954753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:20.001009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d6fd2d-5100-4196-b8ff-58bb63c72976 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:20.074360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:20.074961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:20.075247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:20.075524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:20.077109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:20.181621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:20.185739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:20.187195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd93b46-7d63-45c7-9677-bf2a40be08ff service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:20.204813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 687/1349] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:25.318545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc895-a7e2-451d-a4d0-6bdac249d6ef None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:25.318993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc895-a7e2-451d-a4d0-6bdac249d6ef None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:25.319158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc895-a7e2-451d-a4d0-6bdac249d6ef None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:25.320647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 663/1350] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:25.325397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9ee2-5bf2-49ca-adb4-3516623b3baa None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:25.325776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9ee2-5bf2-49ca-adb4-3516623b3baa None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:25.326572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd9ee2-5bf2-49ca-adb4-3516623b3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:25.426765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7ffd9ee2-5bf2-49ca-adb4-3516623b3baa None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:25.428100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7ffd9ee2-5bf2-49ca-adb4-3516623b3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:25.602263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 688/1351] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:46:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:29.611222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=59 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:29.730087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884996-4fcd-45e1-b6d6-3af5606ec3e6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:29.730379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884996-4fcd-45e1-b6d6-3af5606ec3e6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:29.730840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884996-4fcd-45e1-b6d6-3af5606ec3e6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:29.732303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 664/1352] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:46:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:29.738289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1592-362f-45d7-a464-daf44b6ca0f2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:29.738770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1592-362f-45d7-a464-daf44b6ca0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:29.738870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752a1592-362f-45d7-a464-daf44b6ca0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:29.800954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:29.825560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-752a1592-362f-45d7-a464-daf44b6ca0f2 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:29.826813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-752a1592-362f-45d7-a464-daf44b6ca0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:29.942525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 689/1353] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:46:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:31.411314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba60e8-1e2f-4920-a10e-b7befd9a3435 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:31.411899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba60e8-1e2f-4920-a10e-b7befd9a3435 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:31.411899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba60e8-1e2f-4920-a10e-b7befd9a3435 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:31.413191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 665/1354] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:31.418233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52eac-36df-4292-8c35-69068b62dae4 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:31.418681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52eac-36df-4292-8c35-69068b62dae4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:31.418825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c52eac-36df-4292-8c35-69068b62dae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:31.497145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-93c52eac-36df-4292-8c35-69068b62dae4 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:31.498473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-93c52eac-36df-4292-8c35-69068b62dae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:31.546144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:31.610498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 690/1355] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:46:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:34.975101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f89d8-2564-4509-93d1-7324276475b8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:34.975607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f89d8-2564-4509-93d1-7324276475b8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:34.975607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4f89d8-2564-4509-93d1-7324276475b8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:34.976973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 666/1356] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:34.985705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462c3f-682a-419e-bac8-079fe23bcf5c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:34.986292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462c3f-682a-419e-bac8-079fe23bcf5c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:34.986400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49462c3f-682a-419e-bac8-079fe23bcf5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:35.075651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-49462c3f-682a-419e-bac8-079fe23bcf5c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:35.078671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-49462c3f-682a-419e-bac8-079fe23bcf5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:35.185941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 691/1357] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:35.491522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:35.491813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:35.492094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:35.493432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 667/1358] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:46:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:35.502749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410fe5c-c5e1-4c3a-9dcc-e5227664cc74 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:35.503075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410fe5c-c5e1-4c3a-9dcc-e5227664cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:35.503309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410fe5c-c5e1-4c3a-9dcc-e5227664cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:35.526607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:35.589712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7410fe5c-c5e1-4c3a-9dcc-e5227664cc74 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:35.590954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7410fe5c-c5e1-4c3a-9dcc-e5227664cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:35.715660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 692/1359] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:46:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:35.723494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:35.724965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:35.881681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ee849-8630-4a53-b338-3c85407e16fe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:35.958701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:36.006223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:36.006912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:36.007093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:36.007361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:36.008937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:36.104602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:36.106299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9718c119-30ea-4ed6-a610-25a87e0c7807 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:36.128051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 668/1360] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:38.553366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:38.554010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:38.554010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:38.555228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 693/1361] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:38.561226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1cca-b215-4742-8194-240335ca2a19 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:38.561698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1cca-b215-4742-8194-240335ca2a19 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:38.561797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b1cca-b215-4742-8194-240335ca2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:38.636191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d28b1cca-b215-4742-8194-240335ca2a19 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:38.637716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d28b1cca-b215-4742-8194-240335ca2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:38.694113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:38.766654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 669/1362] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:39.095455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:39.097322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:39.173601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:39.285897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b8c9e-834c-486f-9759-fe0285698ea1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:39.418431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:39.419041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:39.419329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:39.419603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:39.421198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:39.445250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:39.525991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:39.527598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31219906-ddf9-4d70-89e3-9dc188223918 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:39.545463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 694/1363] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:42.049998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938ae4-9aeb-447c-ae8c-9472f972b665 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:42.050560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938ae4-9aeb-447c-ae8c-9472f972b665 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:42.050560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c938ae4-9aeb-447c-ae8c-9472f972b665 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:42.052058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 670/1364] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:42.057261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b825-8215-45bc-be90-fe214a65a39a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:42.058060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b825-8215-45bc-be90-fe214a65a39a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:42.058338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52b825-8215-45bc-be90-fe214a65a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:42.128534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7c52b825-8215-45bc-be90-fe214a65a39a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:42.130296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7c52b825-8215-45bc-be90-fe214a65a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:42.232027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:42.235000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 695/1365] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:42.534657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:42.535066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:42.535449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:42.536995 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 671/1366] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:46:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:42.542559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb343-b4bf-4fbe-8f6f-f748b3bb4202 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:42.542857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb343-b4bf-4fbe-8f6f-f748b3bb4202 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:42.543204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb343-b4bf-4fbe-8f6f-f748b3bb4202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:42.621836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-41ffb343-b4bf-4fbe-8f6f-f748b3bb4202 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:42.623057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-41ffb343-b4bf-4fbe-8f6f-f748b3bb4202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:42.750337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 696/1367] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:46:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:46:42.759507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:42.761178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:42.914556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b9da-4815-45eb-bb70-db618a982670 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:42.936252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:43.037809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:43.038466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:43.038749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:43.039028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:43.040622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:43.137973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:43.139631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7fbd3-4359-4825-8a98-3838879cf1fd service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:43.162243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 672/1368] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:43.262734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c6b-7b15-4baf-a67b-cc5871b03326 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:43.263273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c6b-7b15-4baf-a67b-cc5871b03326 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:43.263273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be29c6b-7b15-4baf-a67b-cc5871b03326 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:43.264755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 697/1369] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:43.271709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230613-a4cb-4b01-9709-a9c02358fb66 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:43.272016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230613-a4cb-4b01-9709-a9c02358fb66 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:43.272267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55230613-a4cb-4b01-9709-a9c02358fb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:43.314397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:43.359537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-55230613-a4cb-4b01-9709-a9c02358fb66 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:43.360778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-55230613-a4cb-4b01-9709-a9c02358fb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:43.479159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 673/1370] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:43.831520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:43.831943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:43.832319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:43.834011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 698/1371] 10.222.0.33 () {54 vars in 964 bytes} [Fri Sep 16 01:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:43.838828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aaf8b-df3f-4af0-9c43-a0f9dae003d8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:43.839120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aaf8b-df3f-4af0-9c43-a0f9dae003d8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:43.839394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949aaf8b-df3f-4af0-9c43-a0f9dae003d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:43.918843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-949aaf8b-df3f-4af0-9c43-a0f9dae003d8 None None] MFA Rules not processed for user `08454b4a2236492b9adacd16cfeec4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:43.920116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-949aaf8b-df3f-4af0-9c43-a0f9dae003d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:43.971260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:44.004332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 674/1372] 10.222.0.33 () {58 vars in 1061 bytes} [Fri Sep 16 01:46:43 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:44.012617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:44.014263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:44.068100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:44.126060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44cca9-1829-4907-862f-93b16dad2b4c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:44.210458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:44.211074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:44.211355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:44.211630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:44.215493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:44.357171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:44.372368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:44.372368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf6e55-28bd-43c1-bc18-6b0efab421ea service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:44.395948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 699/1373] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:46:45.389073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:45.389607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:45.389607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:45.390953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 675/1374] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:45.396130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87dedd-4ae6-47e2-b7e8-7869ae37c250 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:45.396523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87dedd-4ae6-47e2-b7e8-7869ae37c250 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:45.396680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87dedd-4ae6-47e2-b7e8-7869ae37c250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:45.463230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-aa87dedd-4ae6-47e2-b7e8-7869ae37c250 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:45.464445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-aa87dedd-4ae6-47e2-b7e8-7869ae37c250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:45.558608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 700/1375] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:45.846287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:45.847873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:46.010581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a32d6-20ad-493c-8eb5-b4e359abc7f6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:46.065768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:46.129921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:46.130538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:46.130820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:46.131091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:46.132679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:46.225666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:46.227324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a053fea-6a9e-42cc-9331-25497d3b9e0f service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:46.245950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 676/1376] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:48.465365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:48.465946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:48.465946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:48.468411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 701/1377] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:48.473131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea835-d245-4128-ad5d-bc6542054222 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:48.473561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea835-d245-4128-ad5d-bc6542054222 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:48.473740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea835-d245-4128-ad5d-bc6542054222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:48.543169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0baea835-d245-4128-ad5d-bc6542054222 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:48.544331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0baea835-d245-4128-ad5d-bc6542054222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:48.567644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:48.649959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 677/1378] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:48.938839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:48.941118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:49.011212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:49.104341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc30daf-a141-4df2-ba78-7e16293d7ba2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:49.228567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:49.229403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:49.229794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:49.230186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:49.231869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:49.252212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:49.335590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:49.337176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02896d9e-433d-481d-a0c3-36036e300563 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:49.355957 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 702/1379] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:51.566882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:51.567446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:51.567446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:51.568842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 678/1380] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:51.574057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0fc-59e5-4f81-b872-dfae6fa27219 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:51.574464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0fc-59e5-4f81-b872-dfae6fa27219 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:51.574626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1f0fc-59e5-4f81-b872-dfae6fa27219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:51.645552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f3b1f0fc-59e5-4f81-b872-dfae6fa27219 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:51.646803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f3b1f0fc-59e5-4f81-b872-dfae6fa27219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:51.744696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:51.770181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 703/1381] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:52.056987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:52.059002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:52.209214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:52.223509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a834d-d780-4c2e-87c4-b9a6d8e1aebd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:52.350394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:52.351005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:52.351280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:52.351561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:52.353122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:52.445407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:52.447033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d3fe58-7c64-47b7-ad19-ee5a49699ad6 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:52.457062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:52.468558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 679/1382] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:54.723012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:54.723624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:54.723624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:54.724986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 704/1383] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:54.730868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4637-992a-4d8e-9874-359825fbf9ad None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:54.731307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4637-992a-4d8e-9874-359825fbf9ad None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:54.731597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd4637-992a-4d8e-9874-359825fbf9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:54.821466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-13fd4637-992a-4d8e-9874-359825fbf9ad None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:54.823117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-13fd4637-992a-4d8e-9874-359825fbf9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:54.920091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 680/1384] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:46:55.219441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:55.221711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:55.398394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c196df0-4b18-44fe-9b97-601ad054a2e0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:55.472847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:55.524612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:55.525222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:55.525531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:55.526000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:55.527818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:55.631631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:55.634125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a15c15-9529-4a77-939d-eca00cadf7ef service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:55.653106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 705/1385] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:57.805269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:57.805842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:57.805842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:57.807209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 681/1386] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:57.812577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480911-9fda-46f3-af55-9b8f0ca2b12e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:57.813055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480911-9fda-46f3-af55-9b8f0ca2b12e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:57.813180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d480911-9fda-46f3-af55-9b8f0ca2b12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:57.878470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4d480911-9fda-46f3-af55-9b8f0ca2b12e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:57.879662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4d480911-9fda-46f3-af55-9b8f0ca2b12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:57.911712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:57.975732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 706/1387] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:46:58.264193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:46:58.265694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:58.344761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:58.416636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5749ad-91c2-4355-aecd-ac97565b5d23 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:46:58.528109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:46:58.528637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:58.528917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:58.529197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:58.530850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:58.570947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:58.621948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:46:58.623593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e809d-6f24-4579-8d79-3b1b46bf6ee0 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:46:58.641615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 682/1388] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:46:59.607304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080434-e109-4ed5-9818-d3d6f49b8148 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:59.607851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080434-e109-4ed5-9818-d3d6f49b8148 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:59.607851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080434-e109-4ed5-9818-d3d6f49b8148 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:59.609346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 707/1389] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:46:59.614988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491a17-465d-4650-a6b1-7f37477ff56b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:46:59.615427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491a17-465d-4650-a6b1-7f37477ff56b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:46:59.615624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36491a17-465d-4650-a6b1-7f37477ff56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:46:59.682925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-36491a17-465d-4650-a6b1-7f37477ff56b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:46:59.684149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-36491a17-465d-4650-a6b1-7f37477ff56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:46:59.789165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 683/1390] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:46:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:00.096434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:00.096727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:00.097012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:00.098395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 708/1391] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:00.103726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7136a2-06c9-4661-bf69-738d0ede70d0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:00.104019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7136a2-06c9-4661-bf69-738d0ede70d0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:00.104300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7136a2-06c9-4661-bf69-738d0ede70d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:00.120237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:00.183425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8f7136a2-06c9-4661-bf69-738d0ede70d0 None None] MFA Rules not processed for user `943c65ab7c814cc690876b3ba9293756`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:00.184619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8f7136a2-06c9-4661-bf69-738d0ede70d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:00.261111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 684/1392] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:47:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:47:00.271286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:00.272148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:00.381051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb578a-ac5c-4bc3-91cd-6150cb869145 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:00.446523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:00.462237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:00.462846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:00.463128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:00.463403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:00.464993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:00.575242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:00.576681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac86213-a87b-4f51-a35e-91f6a8ba96e2 service glance] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:00.595036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 709/1393] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:00.839358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:00.839959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:00.840068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:00.841469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 685/1394] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:00.847410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b641-e0c7-4a03-a767-5e836443bcef None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:00.847976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b641-e0c7-4a03-a767-5e836443bcef None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:00.847976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3b641-e0c7-4a03-a767-5e836443bcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:00.915284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-12d3b641-e0c7-4a03-a767-5e836443bcef None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:00.916695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-12d3b641-e0c7-4a03-a767-5e836443bcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:00.959058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:01.029910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 710/1395] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:01.326861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:01.328417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:01.345537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93b4f-d119-4544-80c8-1034bf17d73d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:01.345933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93b4f-d119-4544-80c8-1034bf17d73d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:01.346279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa93b4f-d119-4544-80c8-1034bf17d73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:01.415979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-daa93b4f-d119-4544-80c8-1034bf17d73d None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:01.417211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-daa93b4f-d119-4544-80c8-1034bf17d73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:01.433487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:01.481423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1fe9-453e-4685-8a1f-338ea12e9bbe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:01.505850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 711/1396] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:47:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:47:01.548991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bb95-5630-4468-969c-f8fec76bf690 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:01.549280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bb95-5630-4468-969c-f8fec76bf690 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:01.549554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94bb95-5630-4468-969c-f8fec76bf690 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:01.550915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 712/1397] 10.222.0.33 () {54 vars in 943 bytes} [Fri Sep 16 01:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:47:01.557319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf675eb-e974-411b-8c95-970748014e4c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:01.557667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf675eb-e974-411b-8c95-970748014e4c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:01.558034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf675eb-e974-411b-8c95-970748014e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:01.598756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:01.599358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:01.599635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:01.599902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:01.600323 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:01.601488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:01.635829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-adf675eb-e974-411b-8c95-970748014e4c None None] MFA Rules not processed for user `833561908cfb4105b9851563d4253138`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:01.637294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-adf675eb-e974-411b-8c95-970748014e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:01.671261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:01.693133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:01.694776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:01.713502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 686/1398] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:01.754203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 713/1399] 10.222.0.33 () {58 vars in 1040 bytes} [Fri Sep 16 01:47:01 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:47:01.764106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:01.765328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:01.864028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de2c62-a8a1-4aa0-a1c5-e6cdbeb7d01c service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:01.976977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:01.978638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:01.979455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:01.979767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:01.980106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:01.983058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:02.069789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:02.071341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e5089-97d4-4c0d-9850-aa468ea11d0e service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:02.079784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 687/1400] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:47:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:47:03.933600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:03.934231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:03.934231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:03.935529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 714/1401] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:03.940817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70633631-c4c3-4609-804a-15e83260b9b7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:03.941276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70633631-c4c3-4609-804a-15e83260b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:03.941382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70633631-c4c3-4609-804a-15e83260b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:04.009854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-70633631-c4c3-4609-804a-15e83260b9b7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:04.011260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-70633631-c4c3-4609-804a-15e83260b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:04.109464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:04.118080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 688/1402] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:04.407148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:04.409016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:04.504233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:04.570840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f442950-909c-4090-bcfe-eb3c89081024 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:04.693793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:04.694429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:04.694715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:04.694986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:04.696609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:04.757798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:04.794584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:04.796396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ad6e4-36cf-4dc6-b8a0-7e776f088a97 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:04.814937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 715/1403] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:07.054868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275458-9df4-44a9-9534-678672ee641b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:07.055474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275458-9df4-44a9-9534-678672ee641b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:07.055474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5275458-9df4-44a9-9534-678672ee641b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:07.056933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 689/1404] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:47:07.066997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa842-a945-46cb-9462-5791da267344 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:07.066997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa842-a945-46cb-9462-5791da267344 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:07.066997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84fa842-a945-46cb-9462-5791da267344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:07.168337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f84fa842-a945-46cb-9462-5791da267344 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:07.169611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f84fa842-a945-46cb-9462-5791da267344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:07.289921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 716/1405] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:07.579356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5275458-9df4-44a9-9534-678672ee641b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:07.580911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5275458-9df4-44a9-9534-678672ee641b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:07.747200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5275458-9df4-44a9-9534-678672ee641b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:07.824918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:07.879930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:07.880539 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:07.880815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:07.881085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:07.882693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:07.984958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:07.986653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a757ed-4952-4ac7-b7c4-f443553645f3 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:08.006058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 690/1406] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:10.263884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:10.264449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:10.264449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:10.266137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 717/1407] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:10.271535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58092b-5b9e-4cf0-9d07-40e921960502 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:10.272693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58092b-5b9e-4cf0-9d07-40e921960502 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:10.273137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58092b-5b9e-4cf0-9d07-40e921960502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:10.354963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8c58092b-5b9e-4cf0-9d07-40e921960502 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:10.356265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8c58092b-5b9e-4cf0-9d07-40e921960502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:10.387550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:10.464897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 691/1408] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:10.756152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:10.757691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:10.796225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:10.917577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17b2ba-7a78-49d8-9efd-bc1aafe68415 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:11.045224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:11.052844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:11.053549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:11.053952 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:11.054298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:11.055918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:11.159059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:11.161444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9d839-2667-402c-a6e1-40f407e23340 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:11.190175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 718/1409] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:20.463231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=30 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:21.187040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=48 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:24.607878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb4553-b73b-4cfa-90eb-be0dcc6a96ee None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:24.608428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb4553-b73b-4cfa-90eb-be0dcc6a96ee None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:24.608428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fb4553-b73b-4cfa-90eb-be0dcc6a96ee None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:24.609720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 692/1410] 10.222.0.33 () {54 vars in 918 bytes} [Fri Sep 16 01:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:24.614801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ce7a-b041-4ea8-9b62-3f7e9e11a6f8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:24.615197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ce7a-b041-4ea8-9b62-3f7e9e11a6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:24.615357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251ce7a-b041-4ea8-9b62-3f7e9e11a6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:24.693339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a251ce7a-b041-4ea8-9b62-3f7e9e11a6f8 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:24.694596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a251ce7a-b041-4ea8-9b62-3f7e9e11a6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:24.799473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 719/1411] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 01:47:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:24.814199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb26fa-3f18-4b84-bfee-a2ac5b945d3f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:24.814486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb26fa-3f18-4b84-bfee-a2ac5b945d3f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:24.814807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb26fa-3f18-4b84-bfee-a2ac5b945d3f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:24.816118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 693/1412] 10.222.0.33 () {54 vars in 918 bytes} [Fri Sep 16 01:47:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:24.821836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba1f43-46a3-4825-952b-9a277ff2d4af None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:24.822170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba1f43-46a3-4825-952b-9a277ff2d4af None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:24.822456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba1f43-46a3-4825-952b-9a277ff2d4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:24.894306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:24.897534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-18ba1f43-46a3-4825-952b-9a277ff2d4af None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:24.899365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-18ba1f43-46a3-4825-952b-9a277ff2d4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:25.014239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 720/1413] 10.222.0.33 () {58 vars in 1015 bytes} [Fri Sep 16 01:47:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:27.624009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:27.624582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:27.624582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:27.626383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:27.631568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573869-3ed8-49f8-8cd2-fa050c1068af None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:27.631983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573869-3ed8-49f8-8cd2-fa050c1068af None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:27.632127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb573869-3ed8-49f8-8cd2-fa050c1068af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:27.697974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cb573869-3ed8-49f8-8cd2-fa050c1068af None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:27.699183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cb573869-3ed8-49f8-8cd2-fa050c1068af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:27.752989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:27.793825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:28.081720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:28.083412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:28.224584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37893163-828e-4484-a556-0a3500e5c7b9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:28.296732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:28.336880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:28.337424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:28.337701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:28.338003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:28.339590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:28.430007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:28.431673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de76dd-28d4-4e7e-b386-d211530e383f service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:28.449204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 695/1416] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:29.588272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:29.588796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:29.588796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:29.590275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:29.596819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717edd8-9c0f-4f0e-81b7-fcafc5c979f1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:29.597257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717edd8-9c0f-4f0e-81b7-fcafc5c979f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:29.597368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717edd8-9c0f-4f0e-81b7-fcafc5c979f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:29.671621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5717edd8-9c0f-4f0e-81b7-fcafc5c979f1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:29.672900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5717edd8-9c0f-4f0e-81b7-fcafc5c979f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:29.699400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:29.767905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:29.918036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:29.919536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:30.065125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e88435-82e5-485b-a9e4-e506de7778d7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:30.104088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:30.176985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:30.177519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:30.177805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:30.178111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:30.179706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:30.273630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:30.275039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa14d5a-8649-4f9a-8a92-60f44e72018d service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:30.295170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 723/1419] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:31.444274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:31.444846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:31.445084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:31.446461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:47:31.452622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae981-95e2-4ffc-94c1-b0fdb09e9e56 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:31.453020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae981-95e2-4ffc-94c1-b0fdb09e9e56 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:31.453784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ae981-95e2-4ffc-94c1-b0fdb09e9e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:31.508907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:31.530808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-394ae981-95e2-4ffc-94c1-b0fdb09e9e56 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:31.531980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-394ae981-95e2-4ffc-94c1-b0fdb09e9e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:31.627490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:31.779778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:31.781349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:31.924562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccbbf9-c761-41c9-bd59-2abf9a665db6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:31.936476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:32.036996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:32.037517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:32.037792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:32.038085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:32.039656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:32.126178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:32.127758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574a076-d1ed-431d-966f-53a38c0a86ca service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:32.146042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 698/1422] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:33.243459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:33.244057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:33.244057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:33.245405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:33.251419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4fe8-baec-4257-a796-35ff993f7a33 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:33.251878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4fe8-baec-4257-a796-35ff993f7a33 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:33.251976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e4fe8-baec-4257-a796-35ff993f7a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:33.272904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:33.329555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-558e4fe8-baec-4257-a796-35ff993f7a33 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:33.330922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-558e4fe8-baec-4257-a796-35ff993f7a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:33.429805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:33.579898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:33.581417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:33.690675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:33.727900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c39d4d-38a6-4a97-a9f3-823249b2a242 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:33.845618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:33.846187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:33.846469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:33.846743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:33.848335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:33.925213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:33.939591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:33.941191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1febf5e5-5021-49a5-93da-3478368678b9 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:33.959060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 726/1425] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:35.057179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:35.057794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:35.057794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:35.059114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:35.065677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942a800-0837-424a-9b3a-e601c3fd1f26 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:35.066135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942a800-0837-424a-9b3a-e601c3fd1f26 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:35.066266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3942a800-0837-424a-9b3a-e601c3fd1f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:35.140613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3942a800-0837-424a-9b3a-e601c3fd1f26 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:35.142382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3942a800-0837-424a-9b3a-e601c3fd1f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:35.234360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:35.388876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:35.390410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:35.473977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:35.538297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98351e9-aa41-47bf-a00b-79ad05cfc2c3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:35.651221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:35.651852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:35.652131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:35.652400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:35.654033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:35.704587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:35.745337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:35.746970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdd524-4626-44d2-9a40-7a1846419677 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:35.765718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 701/1428] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:36.823841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:36.824388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:36.824388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:36.825752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:36.831960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ec02-338b-4af2-9ebf-a1f8104cea61 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:36.832382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ec02-338b-4af2-9ebf-a1f8104cea61 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:36.832497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e745ec02-338b-4af2-9ebf-a1f8104cea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:36.910394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e745ec02-338b-4af2-9ebf-a1f8104cea61 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:36.911625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e745ec02-338b-4af2-9ebf-a1f8104cea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:37.011511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:37.163677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:37.165133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:37.213100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:37.309595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6148ba-afaf-4bfc-a2cf-4d757c907edd None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:37.422346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:37.422901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:37.423181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:37.423454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:37.425041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:37.431845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:37.514361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:37.515973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef244df3-c03b-430e-b826-351847a0a1f0 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:37.533587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 729/1431] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:38.589696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:38.590245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:38.590245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:38.591533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:38.598371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981f3e-49bc-4137-834b-91edc2cd451e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:38.598843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981f3e-49bc-4137-834b-91edc2cd451e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:38.598958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78981f3e-49bc-4137-834b-91edc2cd451e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:38.675508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-78981f3e-49bc-4137-834b-91edc2cd451e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:38.676748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-78981f3e-49bc-4137-834b-91edc2cd451e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:38.746950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:38.776270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:38.924445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:38.925899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:38.942829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:39.071195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c6312-667d-49c3-9229-101cb47a9387 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:39.156967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:39.182548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:39.183083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:39.183355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:39.183619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:39.185197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:39.273552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:39.274607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23361c4e-da71-4f13-8e19-2aa11787f322 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:39.292743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 704/1434] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:40.351708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:40.352214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:40.352339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:40.353617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:40.361655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca1ee-763f-498a-8228-50d356050544 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:40.362241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca1ee-763f-498a-8228-50d356050544 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:40.362741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dca1ee-763f-498a-8228-50d356050544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:40.438941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-82dca1ee-763f-498a-8228-50d356050544 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:40.440158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-82dca1ee-763f-498a-8228-50d356050544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:40.482294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:40.537502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:40.687468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:40.689034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:40.851034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e66b-27fa-4c19-b009-2913d905a4fb None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:40.905082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:40.962911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:40.963514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:40.963792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:40.964063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:40.965655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:41.060338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:41.062831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d977e4-7f38-4ce4-928d-a2016528047d service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:41.082642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 732/1437] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:42.134599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:42.135164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:42.135164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:42.136518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:42.143069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f6f-c55a-4e44-9790-7d53fac54ebc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:42.143491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f6f-c55a-4e44-9790-7d53fac54ebc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:42.143654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f0f6f-c55a-4e44-9790-7d53fac54ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:42.218168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-838f0f6f-c55a-4e44-9790-7d53fac54ebc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:42.219391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-838f0f6f-c55a-4e44-9790-7d53fac54ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:42.221361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:42.317173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:42.465766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:42.467244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:42.613406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141c422-ecc5-4764-816b-48d860b22b7f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:42.641242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:42.725799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:42.726356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:42.726637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:42.726908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:42.728499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:42.816004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:42.817607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a298baf2-a488-42ad-b3d0-ac8e1fa4ea5f service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:42.835693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 707/1440] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:44.908245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:44.908818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:44.908818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:44.910193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:47:44.915670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1827fa-20c5-44bb-bd6e-c9152aaab5e6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:44.916086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1827fa-20c5-44bb-bd6e-c9152aaab5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:44.916211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1827fa-20c5-44bb-bd6e-c9152aaab5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:44.955985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:44.981967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3c1827fa-20c5-44bb-bd6e-c9152aaab5e6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:44.983257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3c1827fa-20c5-44bb-bd6e-c9152aaab5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:45.078112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:45.361378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:45.362959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:45.466773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10af7e2-293a-4cb2-9075-6125feb438d7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:45.498853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:45.541171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:45.541699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:45.542009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:45.542281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:45.543846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:45.650272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:45.651701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62706412-40c3-4253-beb8-1a56a4103cd3 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:45.669532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 735/1443] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:47.973088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273687b-e11e-454c-b968-21d025e46077 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:47.973661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273687b-e11e-454c-b968-21d025e46077 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:47.973661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273687b-e11e-454c-b968-21d025e46077 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:47.975017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:47.980136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f113c1-2f5f-4c9a-8348-629f88af9110 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:47.980584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f113c1-2f5f-4c9a-8348-629f88af9110 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:47.980693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f113c1-2f5f-4c9a-8348-629f88af9110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:48.045395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-78f113c1-2f5f-4c9a-8348-629f88af9110 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:48.046644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-78f113c1-2f5f-4c9a-8348-629f88af9110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:48.059118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:48.142439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:48.426351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273687b-e11e-454c-b968-21d025e46077 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:48.427903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0273687b-e11e-454c-b968-21d025e46077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:48.531118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273687b-e11e-454c-b968-21d025e46077 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:48.543630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:48.605054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:48.605656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:48.605963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:48.606238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:48.607834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:48.717360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:48.718837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9e7807-28dc-4805-b7ec-7260a0df06bc service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:48.736864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 710/1446] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:51.154207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:51.154762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:51.154762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:51.156131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:51.161464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6fd1-8cf6-4330-bce2-03e633283384 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:51.161959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6fd1-8cf6-4330-bce2-03e633283384 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:51.162074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869e6fd1-8cf6-4330-bce2-03e633283384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:51.209982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:51.227768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-869e6fd1-8cf6-4330-bce2-03e633283384 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:51.228988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-869e6fd1-8cf6-4330-bce2-03e633283384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:51.325122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:51.604922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:51.606567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:51.709115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520c0f1-43c5-4f8c-bd1e-064c6de18ce7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:51.748769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:51.785217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:51.785818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:51.786122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:51.786394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:51.787978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:51.896218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:51.897594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aaea17-da1f-4968-82f9-7a388c3dcaad service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:51.915927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 738/1449] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:54.188363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:54.188906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:54.188906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:54.190313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:47:54.195706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5840-6492-4fb9-a542-9c079cda1c4d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:54.196149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5840-6492-4fb9-a542-9c079cda1c4d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:54.196256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a5840-6492-4fb9-a542-9c079cda1c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:54.264726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cf5a5840-6492-4fb9-a542-9c079cda1c4d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:54.266498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cf5a5840-6492-4fb9-a542-9c079cda1c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:54.287892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:54.363502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:54.651899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:54.653434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:54.756136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19e11c-0658-4942-9401-e71244c158a8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:54.776295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:54.828912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:54.829508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:54.829786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:54.830100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:54.831677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:54.938778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:54.940128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe9c8-7e4d-4d36-9044-a81609f0484c service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:54.958039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 713/1452] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:57.221089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:57.221712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:57.221712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:57.222948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:47:57.228165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33a4f-fcdf-44c7-ba79-f9ea02c80a96 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:57.228611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33a4f-fcdf-44c7-ba79-f9ea02c80a96 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:57.228745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba33a4f-fcdf-44c7-ba79-f9ea02c80a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:57.292207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:57.294819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6ba33a4f-fcdf-44c7-ba79-f9ea02c80a96 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:47:57.296627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6ba33a4f-fcdf-44c7-ba79-f9ea02c80a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:57.390205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:47:57.675376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:47:57.676910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:57.777098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14141c6-7c36-4bbf-ac65-381e5624e9e5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:47:57.825205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:57.848614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:47:57.849211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:47:57.849488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:47:57.849760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:47:57.851351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:47:58.074946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:47:58.076371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93e53a8-2ece-4e2f-993e-856d267899ad service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:47:58.094947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 741/1455] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:47:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:00.392589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:00.393107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:00.393217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:00.394512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:00.399968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85805-f111-4fdf-a677-23b91af4d573 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:00.400449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85805-f111-4fdf-a677-23b91af4d573 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:00.400566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae85805-f111-4fdf-a677-23b91af4d573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:00.465765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4ae85805-f111-4fdf-a677-23b91af4d573 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:00.466993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4ae85805-f111-4fdf-a677-23b91af4d573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:00.496868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:00.564106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:48:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:00.844892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:00.846554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:00.948002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9d19e-56f1-4cb3-b212-ad72ba9ef0c5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:00.975641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:01.027812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:01.028416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:01.028691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:01.028960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:01.031050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:01.138998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:01.140967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae889f9e-cdb0-4195-a7a2-cfe8f2e7bac9 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:01.159043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 716/1458] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:03.373491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:03.374058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:03.374058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:03.375919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:48:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:03.381110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95eac6-ef63-430a-b3e3-6eeb2452d6f9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:03.381498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95eac6-ef63-430a-b3e3-6eeb2452d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:03.381650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95eac6-ef63-430a-b3e3-6eeb2452d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:03.448197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4f95eac6-ef63-430a-b3e3-6eeb2452d6f9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:03.449427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4f95eac6-ef63-430a-b3e3-6eeb2452d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:03.458336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:03.548044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:03.830429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:03.831981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:03.934424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2e5ff-8a55-4559-80e6-8111b8f534df None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:03.989550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:04.006958 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:04.007555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:04.007839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:04.008108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:04.009674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:04.116900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:04.118282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e69638-7128-4704-9ff2-80ae56530123 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:04.136694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 744/1461] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:06.338593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:06.339059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:06.339166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:06.340470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:06.345851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b8d5c-2ba2-4b44-92ae-5fe2cd6a0179 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:06.346327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b8d5c-2ba2-4b44-92ae-5fe2cd6a0179 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:06.346432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708b8d5c-2ba2-4b44-92ae-5fe2cd6a0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:06.411794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-708b8d5c-2ba2-4b44-92ae-5fe2cd6a0179 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:06.413000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-708b8d5c-2ba2-4b44-92ae-5fe2cd6a0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:06.450783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:06.507837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:48:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:06.792073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:06.793650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:06.896540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0399784a-bef2-4512-a2e8-d2ba36de16ab None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:06.935512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:06.972981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:06.973750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:06.974205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:06.974617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:06.976571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:07.086699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:07.088050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de619107-36f8-4dda-92ea-2e35960c2642 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:07.105367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 719/1464] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:09.260311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:09.260882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:09.260882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:09.262535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:09.268062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0ec4-2671-4abc-9318-39fcc1522961 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:09.268523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0ec4-2671-4abc-9318-39fcc1522961 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:09.268690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b0ec4-2671-4abc-9318-39fcc1522961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:09.333753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-308b0ec4-2671-4abc-9318-39fcc1522961 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:09.335011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-308b0ec4-2671-4abc-9318-39fcc1522961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:09.353205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:09.431907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:09.713556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:09.715143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:09.819458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1b5cf-ac50-48f8-963f-d8cf880e2f96 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:09.885279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:09.892750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:09.893349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:09.893630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:09.893929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:09.895495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:10.002878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:10.004304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733d396-298e-445c-880c-17e6ba175577 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:10.022469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 747/1467] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:12.175093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:12.175667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:12.175667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:12.176985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:48:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:12.182392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671bd5c-6411-4976-a5c9-6a30dd2095b2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:12.182797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671bd5c-6411-4976-a5c9-6a30dd2095b2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:12.182941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671bd5c-6411-4976-a5c9-6a30dd2095b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:12.253279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2671bd5c-6411-4976-a5c9-6a30dd2095b2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:12.254517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2671bd5c-6411-4976-a5c9-6a30dd2095b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:12.302796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:12.352045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:48:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:12.633725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:12.635283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:12.737649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaef610-4fd8-4222-a110-7fa4505e2af5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:12.785811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:12.812374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:12.812973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:12.813253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:12.813523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:12.815139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:12.931338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:12.932689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c815a70-fd42-4fe4-9bfa-119076089b3c service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:12.950973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 722/1470] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:22.350418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=22 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:22.948606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=66 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:32.781828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf60172-b32c-40d0-b7cf-71d94bd88038 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:32.782414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf60172-b32c-40d0-b7cf-71d94bd88038 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:32.782414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf60172-b32c-40d0-b7cf-71d94bd88038 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:32.783779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 749/1471] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:32.789037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6c24-35c1-4dc1-a26d-ee63b8238d4d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:32.789471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6c24-35c1-4dc1-a26d-ee63b8238d4d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:32.789581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f6c24-35c1-4dc1-a26d-ee63b8238d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:32.854564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-314f6c24-35c1-4dc1-a26d-ee63b8238d4d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:32.855753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-314f6c24-35c1-4dc1-a26d-ee63b8238d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:32.949474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 723/1472] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:33.246235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:33.246521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:33.246795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:33.248173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 750/1473] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:33.253050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8669-d792-4052-ba4f-b3090c38c9fa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:33.253336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8669-d792-4052-ba4f-b3090c38c9fa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:33.253612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a8669-d792-4052-ba4f-b3090c38c9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:33.330297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-346a8669-d792-4052-ba4f-b3090c38c9fa None None] MFA Rules not processed for user `943c65ab7c814cc690876b3ba9293756`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:33.331513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-346a8669-d792-4052-ba4f-b3090c38c9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:33.351417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:33.408087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 724/1474] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:48:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:33.416152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:33.418024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:33.524921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091b6d5a-4c60-44fa-8b24-c07aa977cac5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:33.600090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:33.600714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:33.601001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:33.601289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:33.602944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:33.656861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:33.712488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:33.713943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319b4686-dc23-4c28-b7a2-3b0931237639 service glance] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:33.732359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 751/1475] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:35.928037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:35.928654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:35.928654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:35.929956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 725/1476] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:35.935207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c383-f0c1-40e5-aaf4-f129d08e9898 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:35.936279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c383-f0c1-40e5-aaf4-f129d08e9898 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:35.936279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3692c383-f0c1-40e5-aaf4-f129d08e9898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:36.000559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3692c383-f0c1-40e5-aaf4-f129d08e9898 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:36.001749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3692c383-f0c1-40e5-aaf4-f129d08e9898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:36.095861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 752/1477] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:48:36.367139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:36.368686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:36.492063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc959e-791d-42e4-bca7-bd75547024de None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:36.541372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:36.585609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:36.586249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:36.586535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:36.586811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:36.587451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:36.589246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:48:36.589246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:48:36.589246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:48:36.590431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76617377-f71e-4ef8-9a25-c2eca46bf0ad admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:36.610380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 726/1478] 10.222.0.33 () {56 vars in 1108 bytes} [Fri Sep 16 01:48:36 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:48:38.776713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:38.777268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:38.777268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:38.778634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 753/1479] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:38.784528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd1db-0db4-41b3-8394-4150fb7ee80d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:38.784984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd1db-0db4-41b3-8394-4150fb7ee80d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:38.785097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1bd1db-0db4-41b3-8394-4150fb7ee80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:38.849965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7e1bd1db-0db4-41b3-8394-4150fb7ee80d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:38.851176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7e1bd1db-0db4-41b3-8394-4150fb7ee80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:38.945847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 727/1480] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:39.242915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:39.244552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:39.254316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:39.391184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd266a-78e0-49c4-a091-5da8db9c8790 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:39.469518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:39.502168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:39.502749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:39.503027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:39.503298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:39.504860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:39.592543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:39.594127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27d5ded-48e2-4c53-b9a8-85edb945162b service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:39.613723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 754/1481] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:41.950733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:41.951805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:41.951805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:41.953100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 728/1482] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:41.958523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379321f-701e-4e19-a56d-652f1b9f125b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:41.958945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379321f-701e-4e19-a56d-652f1b9f125b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:41.959086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c379321f-701e-4e19-a56d-652f1b9f125b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:42.024778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c379321f-701e-4e19-a56d-652f1b9f125b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:42.026032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c379321f-701e-4e19-a56d-652f1b9f125b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:42.075515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:42.126224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 755/1483] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:42.421062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:42.422645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:42.451859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:42.531430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6a2dd-ff60-4218-a51a-16c18ec73ab8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:42.602315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:42.602909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:42.603187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:42.603457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:42.605021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:42.679586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:42.713903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:42.715350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892d19b-59a0-4bea-ab30-cd79a96c3719 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:42.734264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 729/1484] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:44.943981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:44.944559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:44.944559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:44.945876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 756/1485] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:44.951197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbba91-860c-48a9-8afc-da5fddd587f1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:44.951640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbba91-860c-48a9-8afc-da5fddd587f1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:44.951746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbba91-860c-48a9-8afc-da5fddd587f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:45.018229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-99bbba91-860c-48a9-8afc-da5fddd587f1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:45.019448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-99bbba91-860c-48a9-8afc-da5fddd587f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:45.114696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 730/1486] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:45.404859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:45.406471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:45.510599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335c75ca-e4e0-4f34-9e64-0a5867c0bfa0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:45.583478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:45.584953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:45.585646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:45.586148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:45.586581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:45.588324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:45.698959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:45.700393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a586e2-7ca3-422a-be0a-38d214c712d5 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:45.720162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 757/1487] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:47.953034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:47.953617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:47.953617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:47.955039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 731/1488] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:47.960414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d169-6cb7-418e-ada4-55f578a51970 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:47.960807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d169-6cb7-418e-ada4-55f578a51970 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:47.960962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d169-6cb7-418e-ada4-55f578a51970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:48.026749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-aa77d169-6cb7-418e-ada4-55f578a51970 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:48.027956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-aa77d169-6cb7-418e-ada4-55f578a51970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:48.079706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:48.123459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 758/1489] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:48.419985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:48.421532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:48.463952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:48.532466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5da6c-d148-4bd1-b640-7a1c981278a7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:48.609592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:48.610234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:48.610516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:48.610789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:48.612368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:48.692931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:48.722778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:48.724223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46912d90-f072-4240-89ac-a989c3ac2f13 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:48.742578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 732/1490] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:48:51.062931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:51.063512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:51.063512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:51.064815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 759/1491] 10.222.0.33 () {54 vars in 927 bytes} [Fri Sep 16 01:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:48:51.070299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ff57-e1a8-4377-a12a-30a46d0d11dd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:51.070775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ff57-e1a8-4377-a12a-30a46d0d11dd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:51.070879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2ff57-e1a8-4377-a12a-30a46d0d11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:51.149384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cfd2ff57-e1a8-4377-a12a-30a46d0d11dd None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:48:51.150649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cfd2ff57-e1a8-4377-a12a-30a46d0d11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:51.244144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 733/1492] 10.222.0.33 () {58 vars in 1024 bytes} [Fri Sep 16 01:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:48:51.536928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:48:51.538485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:51.639362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202f48f-c737-4e02-b6fb-86e32c6e1fc7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:48:51.711393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:48:51.711992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:48:51.712269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:48:51.712536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:48:51.714139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:48:51.722416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:51.824295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:48:51.826146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90045ff6-fa37-4e7c-a898-3c8fdeeadc47 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:48:51.844191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 760/1493] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:49:01.242639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=82 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:49:01.841847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=50 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:10.248427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:10.249034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:10.249034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:10.325152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:50:10.326379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:10.420120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 734/1494] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:50:10.428108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:10.428597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:10.428706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:10.502807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:50:10.503951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:10.597706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 761/1495] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:50:10.602261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:10.603447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:10.615117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c46febe-c8d1-4473-994a-1a50ccc7fcfe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:10.675712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:10.710073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:10.710682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:10.710959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:10.711230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:10.711862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:50:10.712165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:10.713172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:10.713172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:50:10.713172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:50:10.714636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:10.725622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 735/1496] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:50:10.733980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:10.743059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6122f1-db9f-4552-95c4-8ea74566af53 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:10.802796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:10.836117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:10.836713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:10.836985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:10.837254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:10.837910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:10.839663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:10.839663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:50:10.839663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:50:10.840848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:10.894827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 762/1497] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:50:10 2022] POST /identity/v3/projects => generated 377 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:50:10.898927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:10.900480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:10.933620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5b757d-ce2a-4ea8-b406-c94b220309c1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:11.026932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:11.027542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.027820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.028094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.028726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:11.029735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:11.029735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:50:11.029735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:50:11.030973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:11.072546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 736/1498] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:50:10 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:50:11.077141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:11.078679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.141364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7144f1-27c4-493e-9f2c-9fce6f11378d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:11.223219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:11.234592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:11.235175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.235455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.235727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.236356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:11.237349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:11.237349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:50:11.237349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:50:11.238259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:11.250817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 763/1499] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:50:11.255047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:11.256568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.268305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cbdcb-a581-4b76-babe-2e6022856a69 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:11.293411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:11.363030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:11.363566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.363846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.364119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.364752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:11.365754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:11.365754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:50:11.365754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:50:11.366684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79315d43-d39c-4391-8956-70b6ee8a0dd7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:11.379006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 737/1500] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:50:11.383207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:11.384720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.419393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305d800-cb78-422c-82b1-a3e86cebc723 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:11.511478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:11.512160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.512699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.512968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] PATH_INFO: `/v3/projects/89c6ac6dc5404b08914e0f2e1af30fd5/users/71d00f4f04c247fca6f835ce86e38a14/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.535653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c6ac6dc5404b08914e0f2e1af30fd5, user_id=71d00f4f04c247fca6f835ce86e38a14, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:11.536667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:11.536667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:50:11.536667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:50:11.538642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6dc499-5758-447e-a5ec-5ff30c68f719 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:11.562647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 764/1501] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:50:11 2022] PUT /identity/v3/projects/89c6ac6dc5404b08914e0f2e1af30fd5/users/71d00f4f04c247fca6f835ce86e38a14/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:50:11.575287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff2f9-f6d2-4e50-873c-f0ad2b90f240 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.575578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff2f9-f6d2-4e50-873c-f0ad2b90f240 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.575858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ff2f9-f6d2-4e50-873c-f0ad2b90f240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.632278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-019ff2f9-f6d2-4e50-873c-f0ad2b90f240 None None] MFA Rules not processed for user `71d00f4f04c247fca6f835ce86e38a14`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:50:11.633411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-019ff2f9-f6d2-4e50-873c-f0ad2b90f240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.708612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 738/1502] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:50:11.722161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.722454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.722734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.724090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 765/1503] 10.222.0.33 () {54 vars in 964 bytes} [Fri Sep 16 01:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:50:11.728876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ceb93-2572-4df1-ab1a-62d00a5bfc6a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:11.729722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ceb93-2572-4df1-ab1a-62d00a5bfc6a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:11.730011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ceb93-2572-4df1-ab1a-62d00a5bfc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:11.760639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:11.805754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ad0ceb93-2572-4df1-ab1a-62d00a5bfc6a None None] MFA Rules not processed for user `08454b4a2236492b9adacd16cfeec4e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:50:11.806988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ad0ceb93-2572-4df1-ab1a-62d00a5bfc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.886909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 739/1504] 10.222.0.33 () {58 vars in 1061 bytes} [Fri Sep 16 01:50:11 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:50:11.894783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:11.896364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:11.945458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:11.999362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea2244e-e5cb-4996-824c-9bee72e92d1a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:12.075457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:12.076058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:12.076339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:12.076612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:12.078226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:12.177644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:12.179019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:12.182516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:12.197035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 766/1505] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:50:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:50:12.242798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76a8f-467e-4ef2-87db-92e66509146b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:12.243086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76a8f-467e-4ef2-87db-92e66509146b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:12.243363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b76a8f-467e-4ef2-87db-92e66509146b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:12.244634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 740/1506] 10.222.0.33 () {52 vars in 830 bytes} [Fri Sep 16 01:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:50:12.248246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:12.249461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:12.347261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16ba48-66c7-4373-b71b-0d2cb805a345 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:12.437881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:12.438450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:12.438726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:12.438995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] PATH_INFO: `/v3/users/71d00f4f04c247fca6f835ce86e38a14` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:12.452028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=71d00f4f04c247fca6f835ce86e38a14)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:12.453038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:12.453038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:50:12.453038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:50:12.454277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:12.463659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:12.518977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71d00f4f04c247fca6f835ce86e38a14'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:12.527248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71d00f4f04c247fca6f835ce86e38a14'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:12.527752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71d00f4f04c247fca6f835ce86e38a14'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:12.550082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71d00f4f04c247fca6f835ce86e38a14'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:12.563932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71d00f4f04c247fca6f835ce86e38a14'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:12.569388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 767/1507] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:50:12 2022] DELETE /identity/v3/users/71d00f4f04c247fca6f835ce86e38a14 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:50:12.574404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:12.574888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:12.574998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:12.630948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:50:12.632145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:12.706537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:12.720237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 741/1508] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:50:12.729761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:12.730996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:12.831528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946585d1-abe1-4570-9de9-9f71162975ed admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:12.884148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:12.905804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:12.906449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:12.906729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:12.907001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:12.908585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:13.014715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:13.016140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff19354-9dd7-4229-9b88-17f5f622cd6b service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:13.034040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 768/1509] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:50:13.381398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:50:13.382690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:50:13.395123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5201d791-98f6-49b9-b2bc-02a2a7f7fd7a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:50:13.493973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:50:13.495260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:50:13.495544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:50:13.495817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] PATH_INFO: `/v3/projects/89c6ac6dc5404b08914e0f2e1af30fd5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:50:13.505820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c6ac6dc5404b08914e0f2e1af30fd5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:50:13.506878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:50:13.506878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:50:13.506878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:50:13.508073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:50:13.566777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c6ac6dc5404b08914e0f2e1af30fd5', 'request_id': 'req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:13.576464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c6ac6dc5404b08914e0f2e1af30fd5', 'request_id': 'req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:13.582662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c6ac6dc5404b08914e0f2e1af30fd5', 'request_id': 'req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:13.613481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] The token cache is being invalidate because project 89c6ac6dc5404b08914e0f2e1af30fd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:50:13.613775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:13.614238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7b1c9bb5-5b42-427d-b6e7-fc145e911e86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:50:13.615729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 742/1510] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:50:13 2022] DELETE /identity/v3/projects/89c6ac6dc5404b08914e0f2e1af30fd5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:50:23.031837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=62 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:50:23.611454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:51:42.727704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:42.728276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:42.728276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:42.729533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:51:42.734449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f90e3-3b49-431e-8fe9-ba4ac13611a3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:42.734870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f90e3-3b49-431e-8fe9-ba4ac13611a3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:42.735015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f90e3-3b49-431e-8fe9-ba4ac13611a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:42.931415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8d2f90e3-3b49-431e-8fe9-ba4ac13611a3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:42.933148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8d2f90e3-3b49-431e-8fe9-ba4ac13611a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:43.033904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:51:43.188013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:51:43.190156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:43.306067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad205ded-920e-42e0-a742-fbcd83e31aa3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:51:43.312111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:51:43.312717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:43.312997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:43.313274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:43.321400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:51:43.323750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673f343-2396-4aeb-a9a8-3157a32d0228 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:51:43.332899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 770/1513] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:51:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:51:44.404547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9b04-1431-4514-9520-4c12e9a63800 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:44.405168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9b04-1431-4514-9520-4c12e9a63800 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:44.405168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9d9b04-1431-4514-9520-4c12e9a63800 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:44.406519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:51:44.412928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481b212-4b5d-45eb-86bb-b744d9b6b47f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:44.413409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481b212-4b5d-45eb-86bb-b744d9b6b47f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:44.413528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481b212-4b5d-45eb-86bb-b744d9b6b47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:44.433514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4481b212-4b5d-45eb-86bb-b744d9b6b47f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:44.434771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4481b212-4b5d-45eb-86bb-b744d9b6b47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:44.442533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:51:44.596140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d9b04-1431-4514-9520-4c12e9a63800 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:51:44.611028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9d9b04-1431-4514-9520-4c12e9a63800 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:51:44.616603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:51:44.617205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:44.617487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:44.617762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:44.626361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:51:44.627983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564fd3e1-2103-4550-bb11-cf42043e08cd service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:51:44.638532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 745/1516] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:51:44.676967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcfd1-d05c-40c9-bf2f-7ed4c3bcebe9 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:44.677337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcfd1-d05c-40c9-bf2f-7ed4c3bcebe9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:44.677623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402fcfd1-d05c-40c9-bf2f-7ed4c3bcebe9 None None] PATH_INFO: `/v3` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:44.678972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 772/1517] 10.222.0.20 () {54 vars in 925 bytes} [Fri Sep 16 01:51:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:51:44.685111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e02a-f6e3-40b9-94e5-211dafa18fe2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:44.685404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e02a-f6e3-40b9-94e5-211dafa18fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:44.685683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e02a-f6e3-40b9-94e5-211dafa18fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:44.752265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cbc5e02a-f6e3-40b9-94e5-211dafa18fe2 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:44.753519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cbc5e02a-f6e3-40b9-94e5-211dafa18fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:44.771838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:51:44.829036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 746/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 01:51:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:51:48.348969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d76-d3a1-4179-b432-fca968f07d3b None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:48.349436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d76-d3a1-4179-b432-fca968f07d3b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:48.349541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561d76-d3a1-4179-b432-fca968f07d3b None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:48.350890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 773/1519] 10.222.0.33 () {54 vars in 961 bytes} [Fri Sep 16 01:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:51:48.355856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd04e7-2c69-4b3d-b95b-790af87cd6be None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:48.356330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd04e7-2c69-4b3d-b95b-790af87cd6be None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:48.356429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cd04e7-2c69-4b3d-b95b-790af87cd6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:48.375951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b4cd04e7-2c69-4b3d-b95b-790af87cd6be None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:48.377144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b4cd04e7-2c69-4b3d-b95b-790af87cd6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:48.385514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 747/1520] 10.222.0.33 () {58 vars in 1058 bytes} [Fri Sep 16 01:51:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:51:48.393861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561d76-d3a1-4179-b432-fca968f07d3b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:51:48.406813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561d76-d3a1-4179-b432-fca968f07d3b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:51:48.411901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:51:48.412496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:48.412781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:48.413106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:48.421373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:51:48.422977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4657c3aa-316f-4897-b2e5-7998d61edd1f service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:51:48.432482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 774/1521] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:51:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:51:56.114523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63779455-1912-4e59-a553-d5dd5e457694 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:56.115146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63779455-1912-4e59-a553-d5dd5e457694 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:56.115146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63779455-1912-4e59-a553-d5dd5e457694 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:56.116385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:51:56.123156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fd7a-960c-43c8-b2a5-8101bcc376bb None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:56.123607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fd7a-960c-43c8-b2a5-8101bcc376bb None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:56.123809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976fd7a-960c-43c8-b2a5-8101bcc376bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:56.143278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a976fd7a-960c-43c8-b2a5-8101bcc376bb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:56.144551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a976fd7a-960c-43c8-b2a5-8101bcc376bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:56.152200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:51:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:51:56.304445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63779455-1912-4e59-a553-d5dd5e457694 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:51:56.319521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63779455-1912-4e59-a553-d5dd5e457694 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:51:56.324979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:51:56.325578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:56.325859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:56.326163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:56.334310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:51:56.335900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a423bb60-5873-4945-b10a-8736b4ee03b6 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:51:56.345205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 749/1524] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:51:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:51:57.428190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07d86-8899-4159-9569-70ee78d3da76 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:57.428745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07d86-8899-4159-9569-70ee78d3da76 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:57.428745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce07d86-8899-4159-9569-70ee78d3da76 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:57.430184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Sep 16 01:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:51:57.436973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5eb-3e8b-4941-adfa-50933d6df4f9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:57.437392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5eb-3e8b-4941-adfa-50933d6df4f9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:57.437529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d5eb-3e8b-4941-adfa-50933d6df4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:57.457401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5892d5eb-3e8b-4941-adfa-50933d6df4f9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:51:57.458649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5892d5eb-3e8b-4941-adfa-50933d6df4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:51:57.466597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Sep 16 01:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:51:57.616814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce07d86-8899-4159-9569-70ee78d3da76 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:51:57.631471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce07d86-8899-4159-9569-70ee78d3da76 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:51:57.636872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:51:57.637732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:51:57.638051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:51:57.638368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:51:57.646424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:51:57.647999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee60b1b-34f7-4547-9e47-49137071554f service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:51:57.657182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 777/1527] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:52:01.501288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:01.501860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:01.501860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:01.503211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:52:01.508377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9bdc-d943-4689-bdac-adf1b60cb989 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:01.508841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9bdc-d943-4689-bdac-adf1b60cb989 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:01.508960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a9bdc-d943-4689-bdac-adf1b60cb989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:01.528685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-839a9bdc-d943-4689-bdac-adf1b60cb989 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:52:01.529824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-839a9bdc-d943-4689-bdac-adf1b60cb989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:01.537741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:52:01.827591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:52:01.829274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:01.911266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4663af6-3f0e-429f-bda8-79680e5371ec None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:52:01.914889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:52:01.915497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:01.915777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:01.916046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:01.925559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:52:01.927046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee18ce-d2d4-47ed-aa42-6c04860da90d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:52:01.936640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 752/1530] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:52:04.070752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643790e8-1f30-48b8-9bf6-246b17c46945 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:04.071301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643790e8-1f30-48b8-9bf6-246b17c46945 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:04.071301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643790e8-1f30-48b8-9bf6-246b17c46945 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:04.072682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:52:04.078047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a7e4-f32b-4e99-91b8-25cedc7f4a45 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:04.078465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a7e4-f32b-4e99-91b8-25cedc7f4a45 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:04.078589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a7e4-f32b-4e99-91b8-25cedc7f4a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:04.098059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-aef0a7e4-f32b-4e99-91b8-25cedc7f4a45 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:52:04.099242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aef0a7e4-f32b-4e99-91b8-25cedc7f4a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:04.107813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:52:04.393811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643790e8-1f30-48b8-9bf6-246b17c46945 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:52:04.405204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643790e8-1f30-48b8-9bf6-246b17c46945 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:52:04.408736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:52:04.409324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:04.409607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:04.409916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:04.418618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:52:04.420032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f18a4-520c-4997-a28c-d122255c5600 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:52:04.429194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 780/1533] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:52:07.981686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:07.982302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:07.982302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:07.983617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:52:07.989889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6756008-8bfb-4b3b-a21f-4db7259e66c5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:07.990366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6756008-8bfb-4b3b-a21f-4db7259e66c5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:07.990478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6756008-8bfb-4b3b-a21f-4db7259e66c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:08.011606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d6756008-8bfb-4b3b-a21f-4db7259e66c5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:52:08.013582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d6756008-8bfb-4b3b-a21f-4db7259e66c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:08.021461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:52:08.322210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:52:08.323854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:08.389052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:52:08.402666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d96f2-2343-43d1-bcf8-a46dc3b70977 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:52:08.406278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:52:08.406887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:08.407173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:08.407449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:08.416373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:52:08.417845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead599-5ad9-4b64-bb66-fe7a3d4d746e service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:52:08.427728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 755/1536] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:52:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:52:10.561441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:10.562047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:10.562047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:10.563308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Sep 16 01:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:52:10.568412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a9b7-1293-44ce-aa50-ee12251dfa37 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:10.568828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a9b7-1293-44ce-aa50-ee12251dfa37 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:10.568973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a9b7-1293-44ce-aa50-ee12251dfa37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:10.588119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a3e4a9b7-1293-44ce-aa50-ee12251dfa37 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:52:10.589314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a3e4a9b7-1293-44ce-aa50-ee12251dfa37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:10.597507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Sep 16 01:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:52:10.896753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:52:10.898467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:52:10.911903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ff4ee-691b-43e9-b5d9-027c83c12cd5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:52:10.915369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:52:10.915959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:52:10.916253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:52:10.916530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:52:10.925204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:52:10.926698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e836c-a951-499d-adc9-f4db5ed26b6b service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:52:10.936272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 783/1539] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:52:20.583373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=11 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:52:20.932075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:36.563439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.564210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.564210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.588200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:36.589421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:36.601799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 757/1540] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:53:36.611290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.612103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.612103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.643402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:36.643402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:36.656747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 784/1541] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:36.661606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:36.675946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1180e31-a176-4108-89cf-e4356a54e9ba None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:36.684702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:36.685326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.685604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.685895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.686683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:36.686992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:36.688604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:36.706908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 758/1542] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:36.714913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:36.725112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048a3cb-6395-4f2d-b5b7-98b31237a465 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:36.734386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:36.735013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.735296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.735576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.736244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:36.738263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828c70ef-6827-421d-b248-1220379ff448 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:36.798292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 785/1543] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:36 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:36.802592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:36.821463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dea41f-7550-47d9-9226-de9b2613e92f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:36.868127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee396-8de9-471b-8366-0813a2ccd241 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.868478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee396-8de9-471b-8366-0813a2ccd241 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.868687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cee396-8de9-471b-8366-0813a2ccd241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.904923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-82cee396-8de9-471b-8366-0813a2ccd241 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:36.906232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-82cee396-8de9-471b-8366-0813a2ccd241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:36.957797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:36.959194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:36.959194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:36.959194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:36.960344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:36.961780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36550f-06a8-4c51-abd6-753f786c1ff3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.032858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 759/1544] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:36 2022] POST /identity/v3/users => generated 293 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.034237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.034478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.034759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.077623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 786/1545] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.079424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4c72-5a0e-4824-b85f-341472ba261c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.079721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4c72-5a0e-4824-b85f-341472ba261c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.080031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ca4c72-5a0e-4824-b85f-341472ba261c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.101517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.102849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.116881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-39ca4c72-5a0e-4824-b85f-341472ba261c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.118233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-39ca4c72-5a0e-4824-b85f-341472ba261c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.128460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 760/1546] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.131263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.139344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 787/1547] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.141739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bcf9b-2fd3-413d-9517-b5c227dccfe2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.142056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bcf9b-2fd3-413d-9517-b5c227dccfe2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.142335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053bcf9b-2fd3-413d-9517-b5c227dccfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.153685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645adae-2690-4ad4-a881-74301c17bfc3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.169639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.170302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.171569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.171850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.172548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.174211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ffff9-5a42-43c4-8579-384dc8defda7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.184679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-053bcf9b-2fd3-413d-9517-b5c227dccfe2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.186047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-053bcf9b-2fd3-413d-9517-b5c227dccfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.194723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 761/1548] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:37.197249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3356-2884-4432-ab2b-29a25995950c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.197249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3356-2884-4432-ab2b-29a25995950c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.197249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97be3356-2884-4432-ab2b-29a25995950c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.200179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 788/1549] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.201281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff5f5-165a-45ac-9680-011609eabbd5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.201572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff5f5-165a-45ac-9680-011609eabbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.201851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ff5f5-165a-45ac-9680-011609eabbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.219944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-97be3356-2884-4432-ab2b-29a25995950c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.221172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-97be3356-2884-4432-ab2b-29a25995950c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.221830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-235ff5f5-165a-45ac-9680-011609eabbd5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.223126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-235ff5f5-165a-45ac-9680-011609eabbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.229746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 762/1550] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.231630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 789/1551] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.236162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.236162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.236162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.238841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f87-c7d8-4dac-8d5d-c5ae1622edf3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.239138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f87-c7d8-4dac-8d5d-c5ae1622edf3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.239421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e86f87-c7d8-4dac-8d5d-c5ae1622edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.255297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.256561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.261069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-80e86f87-c7d8-4dac-8d5d-c5ae1622edf3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.262625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-80e86f87-c7d8-4dac-8d5d-c5ae1622edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.279042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 763/1552] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.279207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 790/1553] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.279318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.279318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.279318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.279569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.289717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3417193-7a94-4913-8c0a-d70e45d304cc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.295219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.296642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.296642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.296948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.297555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.299190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.306946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.308166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.310114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 791/1554] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:37.310939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.319312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 764/1555] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.320165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.321648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170394d-13db-4868-83d6-15c71d1c88a0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.329828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57765cf8-ce02-43cf-b7b8-2b3b658b042d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.330287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.330913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.331221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.331501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.332171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.332486 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.333518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:37.333518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:53:37.333518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:53:37.334441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d77895-9947-4c01-8e04-5bcfb5437e0b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.334589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.335168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.335448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.335722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.336360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.336661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.338274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.346941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 792/1556] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.348121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932a34-31b0-496f-98e1-9bc2db69784a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.348409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932a34-31b0-496f-98e1-9bc2db69784a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.348693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01932a34-31b0-496f-98e1-9bc2db69784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.353726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 765/1557] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.353726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.363157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3d26e-d2e6-4ea8-a8f1-895564b74594 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.367911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.368504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.368784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.369058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.369719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.370060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.371738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e561f59-ff40-4501-8454-cf223ca595a6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.371862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-01932a34-31b0-496f-98e1-9bc2db69784a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.373016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-01932a34-31b0-496f-98e1-9bc2db69784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.381589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 793/1558] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.384230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 766/1559] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.385621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002df52-b890-42e0-aa93-dc0cfd9a1000 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.385936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002df52-b890-42e0-aa93-dc0cfd9a1000 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.386070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.386241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e002df52-b890-42e0-aa93-dc0cfd9a1000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.386357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.386525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.405686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.406875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e002df52-b890-42e0-aa93-dc0cfd9a1000 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.407029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.408049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e002df52-b890-42e0-aa93-dc0cfd9a1000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.414966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 794/1560] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.415715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.416158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 767/1561] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.417367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.417650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.417948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.431232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059b888-78dd-45ac-bf8e-f718e22aa02f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.435772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.436991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.437276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.437551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] PATH_INFO: `/v3/projects/4e8c792e5fc64b5794f986dd9ff26ac8/users/88f25bd606054666b7c23f045f90d261/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.439213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.440388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.448919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 768/1562] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.449717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.456189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e8c792e5fc64b5794f986dd9ff26ac8, user_id=88f25bd606054666b7c23f045f90d261, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.458786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d104e31-fa73-4669-bf4e-a5f5269cdf99 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.458977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.463487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.464144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.464420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.464685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.465393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.466478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:37.466478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:53:37.466478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:53:37.467980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.473938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 795/1563] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:37 2022] PUT /identity/v3/projects/4e8c792e5fc64b5794f986dd9ff26ac8/users/88f25bd606054666b7c23f045f90d261/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:37.474960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.500134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 769/1564] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.500134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.518793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:37.531127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:37.543742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50108623-aa10-445c-a92a-3f933cf75c27 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.561436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473c1a8-d45e-4c9c-a0da-99bec07e398a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.566133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.566781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.567016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.567289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.567933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.568238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.569845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.581362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 770/1565] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.582089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.593973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcd390-09c0-4a62-a176-1d76dbbc7b88 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.598593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.599229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.599518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.599790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.600302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.600443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.600910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.601194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.601474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.602136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.602365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.604028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a95ccf-682f-403c-8cbd-abd43c3e8b14 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.630706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 771/1566] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.631207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 796/1567] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 383 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.631743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.632806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.633095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.633372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.652480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.653694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.697929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a7646b-5b33-4170-9151-721c06354663 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.715440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 797/1568] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.715440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.722569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276c39d9-3864-4d64-8b60-4e91057906ac None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.727093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.727679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.727961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.728234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.728876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.729181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.730788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87aef7-4a04-4cb0-99b1-372cb125ed84 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.742491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 798/1569] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.743731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.744019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.744302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.764523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.765640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.765951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.766231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.766903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.767193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.768784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.774070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] MFA Rules not processed for user `88f25bd606054666b7c23f045f90d261`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:37.775270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:37.780549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 772/1570] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.781345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.792288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da07d8-6215-4c74-bd12-ff210c0182e5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.796917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.797503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.797813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.798117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.798737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.800636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.820187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:37.826724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 773/1571] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/users => generated 282 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.826724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.837229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc435-add2-42ee-9963-3949c80bd28b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.841770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.842383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.842662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.842933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.843027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 799/1572] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:37.847594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.847687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.847765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.859624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c6f18-1a0c-4b59-8a8e-34b8d4effd11 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.866702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.867843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.868272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.868421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.870743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.871709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:37.871709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:53:37.871709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:53:37.875320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.881903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 774/1573] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.881903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.890447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:37.901783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 800/1574] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/users => generated 296 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.906692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.916827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b8924-b21d-414b-8322-c4eba78ca93c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.949144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2be562-4843-4447-8926-4640c5899bfc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.953764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.954399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.954680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.954959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.955583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.957497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.972164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.972765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.973050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.973322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.973990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:37.974320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.975882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:37.978755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 775/1575] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:37.979547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.989257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 801/1576] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:37.990275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c562cc-c54c-40f5-9c57-1b7f5a6023b4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:37.991530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:37.995292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:37.995931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:37.996204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:37.996473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:37.997095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:37.999633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.003756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ab6b-eaff-4528-b6d4-e0684ac751cd admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.008870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.009465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.009747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.010064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.010884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.013248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa916563-751e-4ff4-b108-890500913323 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.027750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 776/1577] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.028578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.040841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 802/1578] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:37 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.042545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341114-bc3d-4198-9e04-1b34e3b348b1 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.043013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341114-bc3d-4198-9e04-1b34e3b348b1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.043292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9341114-bc3d-4198-9e04-1b34e3b348b1 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.044645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 803/1579] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:53:38.045368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341114-bc3d-4198-9e04-1b34e3b348b1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.098702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed10443-2227-4be7-b01b-99b836db4243 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.103462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.104098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.104488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.104813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.105458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.107107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.109026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9341114-bc3d-4198-9e04-1b34e3b348b1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.113595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.114224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.114513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.114796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.115432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.117333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.120647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 777/1580] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.120647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.128162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f881df-9fd4-4315-a0f9-f68b8f719953 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.133551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.134401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.134680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.134951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.135567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.137390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.143373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 804/1581] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.143373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.148749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 778/1582] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.149526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.151415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2223cc4-4eca-4aaa-8263-de07b021daac admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.156153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.156742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.157113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.157392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.158057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.159006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb9a5d2-f16f-457c-9f04-3632f6ecd3d2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.159699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.163760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.164332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.164611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.164885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.165527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.167405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.170294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 805/1583] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.171380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.181121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f268e8-ac25-494d-a5c2-8bb35eb0a8ae admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.186030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.186720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.187041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.187317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.187949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.190089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9a195-22c4-48af-8ff5-a594e16d7012 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.197335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 779/1584] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.198160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.211530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:38.217971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 806/1585] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/users => generated 303 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.219138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.219786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.220564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.241525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:38.258597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:38.259815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:38.266045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299f2f4-bb68-43b2-9252-f0e0e08b220e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.274485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.275106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.275391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.275670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.276315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.278320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.301622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 780/1586] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.302486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.314343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c40338-02d4-4e2a-bba2-bd82f50c45c6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.318967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.319548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.319825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.320098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.320765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.322332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.329273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 807/1587] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:38.330277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.332097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 781/1588] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.336130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.340776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0072f322-3d69-4066-ac10-0521b0938f9e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.346755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.346916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea83385-2a40-4a8e-9d6d-9c1627f15743 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.347359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.347631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.347906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.348546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.350214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.351255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.351828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.352109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.352381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.353001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.354598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.360179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 808/1589] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.360970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.366171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 782/1590] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.366994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.374500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412068f0-2089-4f75-a8bf-390fe9abf727 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.376737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d75f214-42e0-41c4-b5e9-b98253d754fc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.378974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.379569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.379852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.380128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.380754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.381612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.382308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.382407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.382593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.382871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.383490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.385498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.396811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 809/1591] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.396811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.406665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48678a12-9b75-4bd1-8211-ac7de5ce7871 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.409134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 783/1592] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:38.410021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.414186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.414815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.415099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.415371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.415997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.417567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.421583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c8072-6cea-44dc-bb40-6463de42ed6d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.426222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.426805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.427082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.427362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.427990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.428277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 810/1593] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.429221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.432447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.439185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1210300-4636-47bf-81d5-f10003e247b9 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.445772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 784/1594] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.445961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.446094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.446197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.446197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.446197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] PATH_INFO: `/v3/projects/894ee0e008ab45f995cf54cccbc11db9/users/a5bfa40d329e4712a78a03e3bf54a240/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.457202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20ad98-6629-4ffa-a518-8f6d8f10871a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.460748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=894ee0e008ab45f995cf54cccbc11db9, user_id=a5bfa40d329e4712a78a03e3bf54a240, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.463352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.463568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.463948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.464232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.464509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.477278 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 811/1595] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/894ee0e008ab45f995cf54cccbc11db9/users/a5bfa40d329e4712a78a03e3bf54a240/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:38.487303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.525723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.527511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.539101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 785/1596] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:38.540362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.552449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf34835-ca54-404b-b5fe-a1216140f2bf service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.564273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8242945-6183-42d6-a134-c31baa982fe5 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.569213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.570035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.570507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.570785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.571431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.573061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.583430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 812/1597] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.584020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.594660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd053bfd-c379-452c-b7c4-649baf9d4278 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.599457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.600097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.600433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.600750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] PATH_INFO: `/v3/projects/306f4565a4dd46e381add34b6d50c4d3/users/dafa7108bd954266a90728b62ad68a37/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.616678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=306f4565a4dd46e381add34b6d50c4d3, user_id=dafa7108bd954266a90728b62ad68a37, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.616859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.617593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.617953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.618290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] PATH_INFO: `/v3/projects/37cd8c478d884b70a2e19ca24fb46829/users/5cc7c221754b4488adff9b193e8e0eec/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.619411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.622491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:38.635259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 813/1598] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/306f4565a4dd46e381add34b6d50c4d3/users/dafa7108bd954266a90728b62ad68a37/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:38.635867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37cd8c478d884b70a2e19ca24fb46829, user_id=5cc7c221754b4488adff9b193e8e0eec, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.637006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:38.637006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:53:38.637006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:53:38.637485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.639098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.642912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:38.662172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 786/1599] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/37cd8c478d884b70a2e19ca24fb46829/users/5cc7c221754b4488adff9b193e8e0eec/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:38.663055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.714414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199e465-1ea3-4d04-bacf-994ef06a69c3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.740018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8648-ba16-4dd3-8669-5911a541f037 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.746376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.747166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.747671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.748110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.749021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.750759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.762771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 787/1600] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.763659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.774525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f19f6-0678-4822-aeb1-e572d80afbd6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.779326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.779898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.780239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.780513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.781145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.782778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75597b3-e55d-46ab-a3bd-3d95a4581150 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.783962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.784723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.785103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.785487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.786252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.788236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.793851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 788/1601] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.795125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73735-7645-4d38-9ef3-24018a4cab38 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.795413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73735-7645-4d38-9ef3-24018a4cab38 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.796199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d73735-7645-4d38-9ef3-24018a4cab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.802938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 814/1602] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:38.803741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.813857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bbde0f-543c-4041-ab12-c5c103c56eea admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.818638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.819274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.819560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.819834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] PATH_INFO: `/v3/projects/b8c08398ef794ebc9e10efd1a7e9c1eb/users/8635a72ff3f74b6c89b841a2fcefbb07/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.825000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-09d73735-7645-4d38-9ef3-24018a4cab38 None None] MFA Rules not processed for user `a5bfa40d329e4712a78a03e3bf54a240`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:38.826268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09d73735-7645-4d38-9ef3-24018a4cab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:38.835240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c08398ef794ebc9e10efd1a7e9c1eb, user_id=8635a72ff3f74b6c89b841a2fcefbb07, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.838045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd3dc95-b1ae-45f5-aa30-8bcdb0e705d9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.851162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 815/1603] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/b8c08398ef794ebc9e10efd1a7e9c1eb/users/8635a72ff3f74b6c89b841a2fcefbb07/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:38.852339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.852616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.852893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.871317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:38.872529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:38.895120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 789/1604] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:38.899356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381b61-1b6e-4dab-8ef5-62f40d6bae68 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.899664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381b61-1b6e-4dab-8ef5-62f40d6bae68 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.899966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba381b61-1b6e-4dab-8ef5-62f40d6bae68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.918187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ba381b61-1b6e-4dab-8ef5-62f40d6bae68 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:38.919382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ba381b61-1b6e-4dab-8ef5-62f40d6bae68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:38.931354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 816/1605] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:38.932171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.941938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92905bf-3081-42ac-a7ef-4b67ed175f8b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:38.946732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:38.947388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.947674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.947953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] PATH_INFO: `/v3/projects/f119ca1b5d65448fbc3446022207c25d/users/c0700bdb1825462ebd9122574bb6aff5/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.959310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:38.964569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f119ca1b5d65448fbc3446022207c25d, user_id=c0700bdb1825462ebd9122574bb6aff5, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:38.968043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:38.980281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 790/1606] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:38.981564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8efb-eb92-476a-8a80-4ead714ebf3e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:38.981849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8efb-eb92-476a-8a80-4ead714ebf3e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:38.982162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8efb-eb92-476a-8a80-4ead714ebf3e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:38.984089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 791/1608] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 01:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:53:38.984770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8efb-eb92-476a-8a80-4ead714ebf3e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.985939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 817/1608] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/f119ca1b5d65448fbc3446022207c25d/users/c0700bdb1825462ebd9122574bb6aff5/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:38.987361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:38.999708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:39.053339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8efb-eb92-476a-8a80-4ead714ebf3e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.054181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c600bb-88e3-47fc-aeae-c7826fb5946c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.058047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.058706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.058965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.059094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.059252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] PATH_INFO: `/v3/projects/dbdce23c85fb4f3a8a9dc8b78503f146/users/b0698ddb5e644183acc33f9d581db93d/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.059565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.059848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.060125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.060757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.062892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68928684-01b9-41c1-8e0f-6201373dbd13 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.075759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 818/1609] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:39.075759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.075759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.076110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbdce23c85fb4f3a8a9dc8b78503f146, user_id=b0698ddb5e644183acc33f9d581db93d, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.076225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.077331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.091348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 792/1610] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:38 2022] PUT /identity/v3/projects/dbdce23c85fb4f3a8a9dc8b78503f146/users/b0698ddb5e644183acc33f9d581db93d/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:39.092355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.096383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:39.097709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.156731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 819/1611] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:39.157769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.159116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad6e622-07d6-41d2-aea2-8f9800d5a2f9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.165069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.165679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.166079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.166284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.166887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.168821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2657a211-4b89-4d57-b353-3252fc103f76 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.198902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 793/1612] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/projects => generated 365 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:39.198902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fdce-096e-4f20-bf33-f39639144f55 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.198902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fdce-096e-4f20-bf33-f39639144f55 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.198902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244fdce-096e-4f20-bf33-f39639144f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.217198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a92f0f-dd09-4a3a-808b-d61f1153da96 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.226628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4244fdce-096e-4f20-bf33-f39639144f55 None None] MFA Rules not processed for user `c0700bdb1825462ebd9122574bb6aff5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:39.227839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4244fdce-096e-4f20-bf33-f39639144f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.258698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:39.278079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.278715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.278998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.279395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.292588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 794/1613] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:39.293839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.294156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.294436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.313601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:39.314860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.319056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:39.342440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.344386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.353924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 820/1614] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.354798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.363956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1abcda2-f062-442a-aa58-46d6e9962092 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.368029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.368906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.369580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.369945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.380439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.382028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df21705-7fb7-41a8-9a5c-b79aa488cc0a service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.388619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 795/1615] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:39.392416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 821/1616] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.393840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.394180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.394525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.394708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.406357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec471aaf-7d60-4061-b0a0-b3775b1a8882 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.411480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.412274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.412623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.412967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] PATH_INFO: `/v3/projects/7cc2bba458bf4cc3aae276ecd83fa7b4/users/2bb7b228b1b34b27bdb83357eef526c7/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.415310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:39.416607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.426032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 822/1617] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:39.427300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.430068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc2bba458bf4cc3aae276ecd83fa7b4, user_id=2bb7b228b1b34b27bdb83357eef526c7, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.432945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.438841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7c79f-dc13-453c-806b-3126e7f9179e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.442858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.443911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.444223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.444407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.448552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 796/1618] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:39 2022] PUT /identity/v3/projects/7cc2bba458bf4cc3aae276ecd83fa7b4/users/2bb7b228b1b34b27bdb83357eef526c7/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:39.449419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.455915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.457587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.470173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 823/1619] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.470932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.482980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dd3b6-dd06-436b-8d8b-de451bfe9140 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.518085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05c5c7-f50d-4785-b52e-2efd412e72ff admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.523584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.524126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.524413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.524691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.525340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.527328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.551360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 797/1620] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:39.552668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.558545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.559171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.559461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.559760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.560367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.562904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.592883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 824/1621] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:39.593837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.596848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.619086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0b122-88f5-4019-9a2e-0aa09f67d8b8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.643462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:39.653902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:39.668161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9b8215-19b6-41da-8dc4-447590e2c55f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.674027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.674759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.675106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.675447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.685180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.685824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.686196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.687174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.744149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.745604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280cf46-2579-4a82-a9e5-25ead0221037 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.756448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 825/1622] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.757801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.758251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.758527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.779185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:39.781135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:39.782254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.784803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.789993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 826/1623] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:39.791218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.801412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 798/1624] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.802298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.815958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523dff86-d41e-44f0-ba73-e7447ed9cd69 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.816990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d860b0-bd31-42ac-acdc-07ad4ec0d002 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.821298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.821957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.822280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.822685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.823313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.825791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.832600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.835224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.836112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.836112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.837774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.840995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.864903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 827/1625] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:39.865974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.889173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 799/1626] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:39 2022] POST /identity/v3/users => generated 309 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:39.896021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.897168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381f067-76c1-44a8-9ed2-884d9f1d0aa3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.907238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.909104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.910905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.911258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.937198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7aaf3-5e98-496b-bdc4-6cd5aab7e0ce admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.939116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.941655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.950209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.950995 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.951400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.951939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] PATH_INFO: `/v3/projects/67b7c30f3fb443169bb0b2ab687006e2/users/a88594e6b8604bf5b6365d8c560f80d9/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.964451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 828/1627] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:39.965471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:39.978083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07bb3b-7196-4c24-8095-2c32fb3f11a1 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:39.983988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:39.984910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:39.985311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:39.985590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:39.986532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.988646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:39.989098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b7c30f3fb443169bb0b2ab687006e2, user_id=a88594e6b8604bf5b6365d8c560f80d9, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:39.993157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.005678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 829/1628] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:40.007052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.022300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a73b3-6875-4514-b8a1-922f298517bb admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.023585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 800/1629] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:39 2022] PUT /identity/v3/projects/67b7c30f3fb443169bb0b2ab687006e2/users/a88594e6b8604bf5b6365d8c560f80d9/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:40.027914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.107302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.107993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.108403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.108583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] PATH_INFO: `/v3/projects/884191c4d1404409bcaa3f72ad185896/users/f7a0754ed7fd432eaea7ef1454e9d74c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.127660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884191c4d1404409bcaa3f72ad185896, user_id=f7a0754ed7fd432eaea7ef1454e9d74c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.131142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.162651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 830/1630] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:40 2022] PUT /identity/v3/projects/884191c4d1404409bcaa3f72ad185896/users/f7a0754ed7fd432eaea7ef1454e9d74c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:40.163652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.168622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac941b-cc6e-494d-bb03-66c518e6e332 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.210759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:40.213773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:40.244780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbf45f6-e34f-408d-9637-1a78f3d6bf50 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.254410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.254645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.256017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.256306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.257225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.263168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.284847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 831/1631] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:40.288056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.290039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.290674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.290955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.291231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.292064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.299562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.317344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ffd507-979a-406c-a076-9f7b63dcb049 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.333282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 801/1632] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:53:40.334409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.342475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.343732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.344019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.344298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] PATH_INFO: `/v3/projects/884191c4d1404409bcaa3f72ad185896/users/f7a0754ed7fd432eaea7ef1454e9d74c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.347229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884191c4d1404409bcaa3f72ad185896, user_id=f7a0754ed7fd432eaea7ef1454e9d74c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.351355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d67493f-1027-4a93-b062-f73231103554 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.355972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09909c0b-2498-4027-a01d-49b8f6e7ee79 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.367952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.368554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.368804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.369086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] PATH_INFO: `/v3/projects/67b7c30f3fb443169bb0b2ab687006e2/users/a88594e6b8604bf5b6365d8c560f80d9/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.371922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 832/1633] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:40 2022] PUT /identity/v3/projects/884191c4d1404409bcaa3f72ad185896/users/f7a0754ed7fd432eaea7ef1454e9d74c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:40.382778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.383064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.383339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.387041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67b7c30f3fb443169bb0b2ab687006e2, user_id=a88594e6b8604bf5b6365d8c560f80d9, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.390625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d77054-90fb-4237-9d65-6b58ce3a3110 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.417257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 802/1634] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:40 2022] PUT /identity/v3/projects/67b7c30f3fb443169bb0b2ab687006e2/users/a88594e6b8604bf5b6365d8c560f80d9/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:40.434242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.434532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.439431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.475243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] MFA Rules not processed for user `f7a0754ed7fd432eaea7ef1454e9d74c`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:40.476643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:40.529006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] MFA Rules not processed for user `a88594e6b8604bf5b6365d8c560f80d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:40.530480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:40.609901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 833/1635] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:40 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:40.619393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.697089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 803/1636] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:40.785856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6a91d-e6e9-4ee4-827d-560777e6a1b6 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.805807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.807824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.808785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.809079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.825318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:40.833719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.835431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.840827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a145607-bad4-4c7e-8e01-7fea0daedbcc None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:40.850762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:40.851494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:40.851648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 834/1637] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:40 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:40.851902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:40.852188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:40.892487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:40.897500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:40.926171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 804/1638] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:41.094438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:41.106116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9f2d3-6189-4d8e-ae2e-5ec434c95cb8 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:41.113362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:41.114445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.115096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.115473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.184087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:41.209247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:41.211880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1463aff-6046-4b4c-a6a9-c09887fbae8d service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:41.237889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 835/1639] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:41.307754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:41.430863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943820df-ad2d-41a8-8c8b-7f53ee3b0a6d service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:41.471541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:41.473449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.475046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.475482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] PATH_INFO: `/v3/users/c0700bdb1825462ebd9122574bb6aff5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.479126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0700bdb1825462ebd9122574bb6aff5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:41.481263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: WARNING py.warnings [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:41.481263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: warnings.warn(msg) Sep 16 01:53:41.481263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: Sep 16 01:53:41.486699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:41.588091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:41.603022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bc3a-3d78-4e87-892e-fecf304738f8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.603519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bc3a-3d78-4e87-892e-fecf304738f8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.604271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d765bc3a-3d78-4e87-892e-fecf304738f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.658083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0700bdb1825462ebd9122574bb6aff5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:41.679714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0700bdb1825462ebd9122574bb6aff5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:41.694685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d765bc3a-3d78-4e87-892e-fecf304738f8 None None] MFA Rules not processed for user `b0698ddb5e644183acc33f9d581db93d`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:41.698371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d765bc3a-3d78-4e87-892e-fecf304738f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:41.739577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0700bdb1825462ebd9122574bb6aff5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:41.741250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0700bdb1825462ebd9122574bb6aff5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:41.766315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b99c607-7a40-4d15-a388-623f9bebad1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0700bdb1825462ebd9122574bb6aff5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:41.780120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 805/1640] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:41 2022] DELETE /identity/v3/users/c0700bdb1825462ebd9122574bb6aff5 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:41.780120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258de22-a419-4a02-8851-629a662e9e04 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.780120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258de22-a419-4a02-8851-629a662e9e04 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.780120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9258de22-a419-4a02-8851-629a662e9e04 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.781525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 806/1641] 10.222.0.33 () {54 vars in 962 bytes} [Fri Sep 16 01:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:53:41.783920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.784381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.784714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.840518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:41.844020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:41.883424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 836/1642] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:53:41.886925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.887413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.887933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.925597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:41.928740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:41.934710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 807/1643] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:41.935701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:41.938640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:41.954993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314f2a1a-5b16-4381-ab20-49bb7cd0769b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:41.960001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:41.960726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:41.960962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:41.961220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:41.961933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:41.963987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:41.999788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 808/1644] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:41 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:42.001169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.002873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:42.071567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 837/1645] 10.222.0.33 () {58 vars in 1059 bytes} [Fri Sep 16 01:53:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:42.074928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.081474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f8ba0-32bb-4dac-8323-27389a474c17 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.096609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.097315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.098741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.099029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.099648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5937ee2-d7e0-4cfb-9bf8-882c1fed5ee7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.198225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:42.262828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.263479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.264656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.265861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.266245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.267390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.271901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b539a84b-ebf1-45cd-8d6e-587ca868600d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.274912 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.308859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 809/1646] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:42.312984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:42.313496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1e72e-9166-4270-9f91-a57498775303 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.316797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1e72e-9166-4270-9f91-a57498775303 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.318745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1e72e-9166-4270-9f91-a57498775303 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.321560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 810/1647] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 01:53:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:53:42.329320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.330031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.330306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.355226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 838/1648] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:42 2022] POST /identity/v3/users => generated 309 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:42.360729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.386003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeee8b-b135-4adc-9b08-76769afe7fc2 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.395308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:42.397558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:42.402220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.403058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.403344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.403722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.404375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.407782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.442767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 839/1649] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:42.443947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.473059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d45977-ee6b-483b-98ab-c4dc51e67766 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.482622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.483876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.484168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.487074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] PATH_INFO: `/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f/users/714a718936824cd6969d66b5271a626c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.521683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9f18e1e62a4f5a9e0fea437b1af53f, user_id=714a718936824cd6969d66b5271a626c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.529463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.559757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 840/1650] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:42 2022] PUT /identity/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f/users/714a718936824cd6969d66b5271a626c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:42.564188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.568207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 811/1651] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:53:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:42.586616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.589472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:42.677089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd6270-995d-4c38-a07e-ec8942ea1814 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.716859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db228d-2ecd-4bd0-973d-f74be68b8a9b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.723475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.724107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.724388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.724657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.725596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.727601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.742947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 841/1652] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:53:42.749146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:42.762413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.762951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.763421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.763760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.781163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f09ddb-1656-475b-afa1-6bb79d6f6f05 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:42.797512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:42.798273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:42.798554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:42.799429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] PATH_INFO: `/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f/users/714a718936824cd6969d66b5271a626c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:42.806854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa9f18e1e62a4f5a9e0fea437b1af53f, user_id=714a718936824cd6969d66b5271a626c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.811683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.813375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:42.843814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 842/1653] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:42 2022] PUT /identity/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f/users/714a718936824cd6969d66b5271a626c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:42.880094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:42.883136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:42.903629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 812/1654] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:43.278704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:43.283095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:43.439867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99847891-41bf-4c60-a577-40acadd13ae6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:43.454100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:43.454724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:43.455010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:43.455287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] PATH_INFO: `/v3/projects/f119ca1b5d65448fbc3446022207c25d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:43.459112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f119ca1b5d65448fbc3446022207c25d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:43.462350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: WARNING py.warnings [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 16 01:53:43.462350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: warnings.warn(msg) Sep 16 01:53:43.462350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: Sep 16 01:53:43.463610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:43.606743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:43.613991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f119ca1b5d65448fbc3446022207c25d', 'request_id': 'req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:43.631796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f119ca1b5d65448fbc3446022207c25d', 'request_id': 'req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:43.645033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f119ca1b5d65448fbc3446022207c25d', 'request_id': 'req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:43.694839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] The token cache is being invalidate because project f119ca1b5d65448fbc3446022207c25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:43.695215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:43.695949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:43.697779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 843/1655] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:43 2022] DELETE /identity/v3/projects/f119ca1b5d65448fbc3446022207c25d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:43.702340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:43.744497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983374f2-02ef-44e8-ae59-ae5e4e40805c service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:43.929385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:43.930281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:43.930664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:43.930950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] PATH_INFO: `/v3/users/f7a0754ed7fd432eaea7ef1454e9d74c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:43.932460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7a0754ed7fd432eaea7ef1454e9d74c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:43.945169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:44.026693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7a0754ed7fd432eaea7ef1454e9d74c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:44.041190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7a0754ed7fd432eaea7ef1454e9d74c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:44.062414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7a0754ed7fd432eaea7ef1454e9d74c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:44.067047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7a0754ed7fd432eaea7ef1454e9d74c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:44.077904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7a0754ed7fd432eaea7ef1454e9d74c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:44.089914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 813/1656] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:43 2022] DELETE /identity/v3/users/f7a0754ed7fd432eaea7ef1454e9d74c => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:45.178215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:45.179710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:45.206088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291f7cd-ae78-444e-aca5-a9ed9d3b6922 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:45.392990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:45.393670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:45.393985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:45.394268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] PATH_INFO: `/v3/projects/884191c4d1404409bcaa3f72ad185896` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:45.395536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=884191c4d1404409bcaa3f72ad185896)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:45.397731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:45.504439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:45.506003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:45.520384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884191c4d1404409bcaa3f72ad185896', 'request_id': 'req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.525117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad6090f-ce18-41c5-91b5-a0d5deabf6aa admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:45.541786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884191c4d1404409bcaa3f72ad185896', 'request_id': 'req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.562924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884191c4d1404409bcaa3f72ad185896', 'request_id': 'req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.606988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] The token cache is being invalidate because project 884191c4d1404409bcaa3f72ad185896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:45.607269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.608745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9cc5f646-fa61-4605-b8a4-3c7f08d8fb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.610517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 844/1657] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:45 2022] DELETE /identity/v3/projects/884191c4d1404409bcaa3f72ad185896 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:45.616022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce7d-c5a0-4f45-907d-5e9f320f7d8d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:45.626289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce7d-c5a0-4f45-907d-5e9f320f7d8d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:45.628092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d235ce7d-c5a0-4f45-907d-5e9f320f7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:45.674514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:45.687004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d235ce7d-c5a0-4f45-907d-5e9f320f7d8d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:45.694698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d235ce7d-c5a0-4f45-907d-5e9f320f7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:45.762745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:45.763425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:45.763712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:45.763988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] PATH_INFO: `/v3/users/a5bfa40d329e4712a78a03e3bf54a240` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:45.766113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5bfa40d329e4712a78a03e3bf54a240)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:45.768760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:45.919728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 845/1658] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:45.930871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:45.933974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:45.934740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:45.962371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5bfa40d329e4712a78a03e3bf54a240'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:45.975115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:46.001972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5bfa40d329e4712a78a03e3bf54a240'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:46.030435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:46.032486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5bfa40d329e4712a78a03e3bf54a240'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:46.033451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5bfa40d329e4712a78a03e3bf54a240'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:46.034139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:46.044512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1d9687d3-d8fc-421c-a24e-754157f8d01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5bfa40d329e4712a78a03e3bf54a240'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:46.054828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 814/1659] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:45 2022] DELETE /identity/v3/users/a5bfa40d329e4712a78a03e3bf54a240 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:46.063564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:46.064739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:46.065099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:46.073080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 846/1660] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:53:46.080517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:46.105913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bff9c-8e37-400c-95df-1dac280db072 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:46.125464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:46.127917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:46.339856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:46.347939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:46.348452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:46.348965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:46.357088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:46.360445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:46.366776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:46.385556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 815/1661] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:46.425520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 847/1662] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:46.427691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:46.441389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1572c56-7023-440e-9729-e0d7effda231 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:46.453918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:46.455600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:46.461493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:46.463039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:46.463164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:46.463886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:46.465183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:46.486362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:46.656354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5578b60-02f8-4b95-a895-4ee625a5de9a admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:46.671783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 816/1663] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:46 2022] POST /identity/v3/projects => generated 365 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:53:46.676557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:46.692811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:46.693484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:46.694149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:46.694149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:46.726509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:46.728064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:46.747306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 848/1664] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:46.814442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:46.816629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:46.833394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:46.852002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfb945-02d6-4466-b592-0c3e73c0b716 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:46.954943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afcf750-a274-4991-8e7d-cefbe90f330c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:46.966526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:46.967186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:46.967541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:46.967817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:46.968462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:46.970447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.025832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 817/1665] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:46 2022] POST /identity/v3/users => generated 283 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:47.031609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.058767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92435455-c4d2-4457-8fd8-e119ba0ac3b0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:47.065225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:47.065861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.068392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.068647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.069348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:47.071044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.098344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 818/1666] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:47.102491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.135062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e507ae6-0b64-4bd0-993b-50ed71326bd6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:47.141610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:47.145413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:47.146114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.146396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.146652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.146769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.147648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.148306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] PATH_INFO: `/v3/users/88f25bd606054666b7c23f045f90d261` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.150637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:47.151512 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f25bd606054666b7c23f045f90d261)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:47.152277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.157245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.203726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 819/1667] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:53:47.207557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.242646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:47.251952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee403f1-1805-4444-a366-e6672a7b64fc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:47.274967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f25bd606054666b7c23f045f90d261'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:47.283492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:47.289762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.290156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f25bd606054666b7c23f045f90d261'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:47.290981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f25bd606054666b7c23f045f90d261'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:47.299225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.299225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] PATH_INFO: `/v3/projects/dba3c72a4bd84e66a1903a221aacc60a/users/8246970a787941ba950622c8497ddb63/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.316341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f25bd606054666b7c23f045f90d261'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:47.336973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6677ab5-a9fe-455a-96b8-c1689755aabb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f25bd606054666b7c23f045f90d261'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:47.351824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 849/1668] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:46 2022] DELETE /identity/v3/users/88f25bd606054666b7c23f045f90d261 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:47.356443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.356882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.357229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.361343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dba3c72a4bd84e66a1903a221aacc60a, user_id=8246970a787941ba950622c8497ddb63, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:47.364135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405d073-5c6e-4f10-9789-3bf76d596812 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.408895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:47.410397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:47.416016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 820/1669] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:47 2022] PUT /identity/v3/projects/dba3c72a4bd84e66a1903a221aacc60a/users/8246970a787941ba950622c8497ddb63/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:47.427153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.428007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.428754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.521703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] MFA Rules not processed for user `8246970a787941ba950622c8497ddb63`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:47.523144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:47.589752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 850/1670] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:47.713768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 821/1671] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:47.714899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.716376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:47.737686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.740589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:47.741627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad97fc8-1a21-4df2-8f2d-2452e8640c74 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:47.766311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:47.766951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:47.767239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:47.767524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:47.768370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:47.775414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:47.843470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 851/1672] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:47 2022] POST /identity/v3/projects => generated 361 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:47.844842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:47.922469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeec6c4-95b9-47b6-89ed-aef151d818ad None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:47.988970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:48.030636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738784cd-1659-4b05-ad0d-5aef9598a33f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:48.038294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.038920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.039197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.039479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.040761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.042877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d22ce-d012-4efd-a392-cb850b4f4ea2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.055027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.055673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.055953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.056220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.082311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.083699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.093919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 852/1673] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:47 2022] POST /identity/v3/users => generated 287 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:53:48.099635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.099956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.100211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.123074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 822/1674] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:48.131933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:48.168029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f11c6ea-652b-4e4c-9aae-e317fcaca735 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:48.180083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] MFA Rules not processed for user `714a718936824cd6969d66b5271a626c`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:48.181340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:48.183534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.184473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.184925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.185456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.186904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.190558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.207437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:48.236313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 823/1675] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:48.240965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:48.256624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d92ec-761a-49a6-8fce-02f1386abdb3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:48.272329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.272329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.272329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.272329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] PATH_INFO: `/v3/projects/76ca0041462942ada1eeffcc2dac0155/users/c053da59250d48e88644bca1c5a13218/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.318550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca0041462942ada1eeffcc2dac0155, user_id=c053da59250d48e88644bca1c5a13218, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.321748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.364753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 853/1676] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:48 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:48.385602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 824/1677] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:48 2022] PUT /identity/v3/projects/76ca0041462942ada1eeffcc2dac0155/users/c053da59250d48e88644bca1c5a13218/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:48.386954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:48.410739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb674bbc-850c-4bb8-a87f-dd949fbf837c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:48.532752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.533745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.534307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.534792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.535717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.538204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10e665-1afd-46e4-a46b-cff69a66ecd5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.581089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:48.596270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1507-8e78-4720-865b-7f43743891e1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:48.599882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 854/1678] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:48.615259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:48.616256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.616683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.617131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] PATH_INFO: `/v3/projects/76ca0041462942ada1eeffcc2dac0155/users/c053da59250d48e88644bca1c5a13218/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.623875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ca0041462942ada1eeffcc2dac0155, user_id=c053da59250d48e88644bca1c5a13218, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:48.631092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:48.668935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:48.669228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:48.669506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:48.672772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 825/1679] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:48 2022] PUT /identity/v3/projects/76ca0041462942ada1eeffcc2dac0155/users/c053da59250d48e88644bca1c5a13218/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:48.739746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] MFA Rules not processed for user `c053da59250d48e88644bca1c5a13218`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:48.741099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:48.891704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 855/1680] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:48 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:48.904099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:48.907613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:49.029395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7680f708-dbde-4d77-ac81-3f1c197ea002 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:49.042676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:49.043426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:49.044055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:49.044055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:49.070466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:49.071646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:49.086708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 826/1681] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:48 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:49.258965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:49.277674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31a7610-e9ce-4fa2-8f3a-4d0bb02cc63e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:49.291396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:49.292706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:49.293007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:49.293333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:49.432907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:49.524132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:49.537016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:49.538903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:49.542193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:49.570264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 856/1682] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:49.684457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351114d7-3cd2-4db9-b849-309541ccc6bd service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:49.692813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:49.694318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:49.705306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:49.705970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] PATH_INFO: `/v3/projects/894ee0e008ab45f995cf54cccbc11db9` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:49.708333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] RBAC: Authorizing `identity:delete_project(project_id=894ee0e008ab45f995cf54cccbc11db9)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:49.711328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:49.802574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:49.844669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '894ee0e008ab45f995cf54cccbc11db9', 'request_id': 'req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:49.869529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '894ee0e008ab45f995cf54cccbc11db9', 'request_id': 'req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:49.885455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '894ee0e008ab45f995cf54cccbc11db9', 'request_id': 'req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:49.903976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] The token cache is being invalidate because project 894ee0e008ab45f995cf54cccbc11db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:49.904295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:49.905520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:49.907733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 827/1683] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:49 2022] DELETE /identity/v3/projects/894ee0e008ab45f995cf54cccbc11db9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:49.912158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:49.925639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba401d2-7761-4191-b5df-10d55c3ea775 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:49.972520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:49.974511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:50.079343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.080413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.080911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.081403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] PATH_INFO: `/v3/users/a88594e6b8604bf5b6365d8c560f80d9` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.089757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88594e6b8604bf5b6365d8c560f80d9)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.093273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.146818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d11a61-8187-431f-9ae4-a0eeb1b3153e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:50.155303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.155888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.156170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.156445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] PATH_INFO: `/v3/projects/4e8c792e5fc64b5794f986dd9ff26ac8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.158391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e8c792e5fc64b5794f986dd9ff26ac8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.159761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.251327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e8c792e5fc64b5794f986dd9ff26ac8', 'request_id': 'req-2e972c5b-cfbf-43b3-81c5-94f537b4de26'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.252498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88594e6b8604bf5b6365d8c560f80d9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.269954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88594e6b8604bf5b6365d8c560f80d9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.270919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88594e6b8604bf5b6365d8c560f80d9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.275968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e8c792e5fc64b5794f986dd9ff26ac8', 'request_id': 'req-2e972c5b-cfbf-43b3-81c5-94f537b4de26'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.284405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e8c792e5fc64b5794f986dd9ff26ac8', 'request_id': 'req-2e972c5b-cfbf-43b3-81c5-94f537b4de26'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.298869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] The token cache is being invalidate because project 4e8c792e5fc64b5794f986dd9ff26ac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:50.299166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.299885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e972c5b-cfbf-43b3-81c5-94f537b4de26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.305001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 828/1684] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:49 2022] DELETE /identity/v3/projects/4e8c792e5fc64b5794f986dd9ff26ac8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:50.308351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.308886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.309168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.341464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88594e6b8604bf5b6365d8c560f80d9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.342826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:50.344066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:50.361417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-463fa320-dfcd-4898-b85f-12cb635fd6a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88594e6b8604bf5b6365d8c560f80d9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:50.378934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 857/1685] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:49 2022] DELETE /identity/v3/users/a88594e6b8604bf5b6365d8c560f80d9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:50.421021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:50.459021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 829/1686] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:50.460628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.461261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.461261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.491504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:50.493460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:50.548276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:50.577426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 858/1687] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:50.581591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:50.595844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6755182-e03b-4171-bd8b-847521f13a60 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:50.601140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.601987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.602270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.602544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.603197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:50.603490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.605310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.620719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 830/1688] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:50.626072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:50.635841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd7af2-41e2-451f-ae8c-0a18b653fcb5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:50.643012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.643740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.644093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.644648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.645768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.649797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.689643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 859/1689] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:50 2022] POST /identity/v3/projects => generated 353 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:53:50.694060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:50.705679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391d08d-e3c5-48e0-bf3d-d0a7ee178187 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:50.855235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.856292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.856292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.856524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.857150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.859530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.897385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 831/1690] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:50 2022] POST /identity/v3/users => generated 277 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:50.900982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:50.912595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33f69a5-13b3-4e52-bf6e-d8e8c0f3773d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:50.933560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:50.934220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:50.934505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:50.934779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:50.935432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:50.939125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:50.965016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 860/1691] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:50.968855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:50.984270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11231dc-3b4b-4ea2-9b3c-c7dbfef13ad0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:51.010434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:51.011077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.011354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.011911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.012550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:51.014354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d60b5e-27f8-4a6b-82c5-3422370a2e45 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:51.059207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 832/1692] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:51.064607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:51.081115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1b5b5-d5b0-4711-bb1c-0592c363b3ca admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:51.097166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:51.097916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.098308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.098590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] PATH_INFO: `/v3/projects/0a72137f57cd42ae91cac220cfc744a4/users/a24019e24a1845c384e1b64fdb0c93f2/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.141908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a72137f57cd42ae91cac220cfc744a4, user_id=a24019e24a1845c384e1b64fdb0c93f2, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:51.147893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:51.191335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 861/1693] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:51 2022] PUT /identity/v3/projects/0a72137f57cd42ae91cac220cfc744a4/users/a24019e24a1845c384e1b64fdb0c93f2/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:51.194756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.195274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.195745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.271786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] MFA Rules not processed for user `a24019e24a1845c384e1b64fdb0c93f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:51.273353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:51.452569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:51.458520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 833/1694] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:51 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:51.618480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fb480-f677-4d59-8d16-9168cd4523ab admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:51.630689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:51.631330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.631621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.632043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.632704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:51.637465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ef28aa-a217-4ce1-9278-4cb7799564af admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:51.703208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:51.713027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 862/1695] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:51 2022] POST /identity/v3/projects => generated 357 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:51.731581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b889cd-e362-4e42-8538-d721cad77cd5 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:51.763818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879800-ec1f-42ea-8771-cfd20859f4d4 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.764889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879800-ec1f-42ea-8771-cfd20859f4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.765352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7879800-ec1f-42ea-8771-cfd20859f4d4 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.767598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 863/1696] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:53:51.823188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:51.872218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:51.872853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.873130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.874320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.874695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:51.878863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:51.926631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 834/1697] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:51 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:51.930786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7879800-ec1f-42ea-8771-cfd20859f4d4 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:51.953795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7879800-ec1f-42ea-8771-cfd20859f4d4 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:51.963945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:51.964592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:51.964878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:51.965157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:51.970668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:51.972268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19bf44-3f27-4115-8af0-acefabf5fe58 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.001648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 864/1698] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:53:52.006000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.022745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9407e116-9ec8-4ad7-8d8f-27514da7199b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:52.034860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:52.035799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.037184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.037613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] PATH_INFO: `/v3/projects/d1156f533f034629a2bff76489ae42a6/users/cc73aa96637d426db68de82b2a8a4a85/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.100064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1156f533f034629a2bff76489ae42a6, user_id=cc73aa96637d426db68de82b2a8a4a85, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:52.109325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.139543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025fc0-2b47-4d93-a800-d3b6b565c039 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.140800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025fc0-2b47-4d93-a800-d3b6b565c039 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.141252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26025fc0-2b47-4d93-a800-d3b6b565c039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.175903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 835/1699] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:52 2022] PUT /identity/v3/projects/d1156f533f034629a2bff76489ae42a6/users/cc73aa96637d426db68de82b2a8a4a85/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:52.176872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.209645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-26025fc0-2b47-4d93-a800-d3b6b565c039 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:52.211691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-26025fc0-2b47-4d93-a800-d3b6b565c039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:52.332594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d34814-702c-4a74-9ba7-09184a8abe29 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:52.340831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:52.341369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.341650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.341982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.342686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:52.344298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.371282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:52.377283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 836/1700] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:52.381798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.391245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 865/1701] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:53:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:52.412777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c659f8-880d-4f21-bed6-dd1058a8598f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:52.418700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:52.419545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.419883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.420699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] PATH_INFO: `/v3/projects/d1156f533f034629a2bff76489ae42a6/users/cc73aa96637d426db68de82b2a8a4a85/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.427695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1156f533f034629a2bff76489ae42a6, user_id=cc73aa96637d426db68de82b2a8a4a85, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:52.430522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.464723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 837/1702] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:52 2022] PUT /identity/v3/projects/d1156f533f034629a2bff76489ae42a6/users/cc73aa96637d426db68de82b2a8a4a85/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:52.477765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.478310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.479340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.524316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] MFA Rules not processed for user `cc73aa96637d426db68de82b2a8a4a85`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:52.531085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:52.642844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.645011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:52.702575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 866/1703] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:52.719291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.721986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:52.793027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ede92e-e72d-4cb8-8aac-0b9390669e06 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:52.801101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:52.802006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.802427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.802842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.821591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:52.823512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.830833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb1dce-f995-4cef-bc38-90fe237fb6d2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:52.841055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 838/1704] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:52.842602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:52.843447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:52.843949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:52.844416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:52.846289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:52.849657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:52.877205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:52.881085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:52.920691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 867/1705] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:52.924038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:53.021132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e5cd6-3987-4175-9efc-57e46bfd1993 service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:53.027158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:53.028628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.028746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.029134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] PATH_INFO: `/v3/projects/67b7c30f3fb443169bb0b2ab687006e2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.030744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67b7c30f3fb443169bb0b2ab687006e2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:53.032876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:53.104991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67b7c30f3fb443169bb0b2ab687006e2', 'request_id': 'req-2e9aee5b-5cff-4a19-bab6-21ebe861999d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:53.117793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67b7c30f3fb443169bb0b2ab687006e2', 'request_id': 'req-2e9aee5b-5cff-4a19-bab6-21ebe861999d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:53.134509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67b7c30f3fb443169bb0b2ab687006e2', 'request_id': 'req-2e9aee5b-5cff-4a19-bab6-21ebe861999d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:53.140402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:53.159196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8e786-a60f-40a1-814f-5ea0b3097c1d service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:53.206559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] The token cache is being invalidate because project 67b7c30f3fb443169bb0b2ab687006e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:53.207478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:53.208265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-2e9aee5b-5cff-4a19-bab6-21ebe861999d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:53.213110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 839/1706] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:52 2022] DELETE /identity/v3/projects/67b7c30f3fb443169bb0b2ab687006e2 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:53.218896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fa87-ed90-42aa-b9e7-57315e9627d1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.219092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fa87-ed90-42aa-b9e7-57315e9627d1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.219662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a11fa87-ed90-42aa-b9e7-57315e9627d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.274150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3a11fa87-ed90-42aa-b9e7-57315e9627d1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:53.278161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3a11fa87-ed90-42aa-b9e7-57315e9627d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:53.309297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:53.312513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.312809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.313084 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.319568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:53.417258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:53.427454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 840/1707] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:53.436715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.437017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.437277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.462297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:53.464310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:53.477630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 868/1708] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:53 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:53.482756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:53.484619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:53.500765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 841/1709] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:53.504282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:53.520471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f43fd-288f-4ae7-bf68-32f104f65ad0 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:53.533263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:53.536038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.536533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.537030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.537768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:53.540410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:53.544147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:53.574260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 869/1710] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:53.578840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:53.626328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28416fd0-64b9-4570-bf5a-ba5a12dae5b3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:53.660333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:53.670700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:53.673175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:53.674933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:53.680298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:53.716326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:53.787626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 842/1711] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:53 2022] POST /identity/v3/projects => generated 379 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:53.792639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:53.805899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fac6d5-2686-4a2d-a474-a7b1f8df86cf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.046893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:54.047861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.048304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.048860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.050525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:54.053036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:54.103053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 870/1712] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:53 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:54.108332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:54.125202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0da5d3-54fe-4246-8384-4d53fc765ae6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.138962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:54.139594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.139876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.140150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.140797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:54.142621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:54.176740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 843/1713] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:54.179753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:54.199728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668a56d8-3d1f-4f0f-89c8-e4c61530cab4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.226260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:54.227090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.227530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.227940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.228795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:54.231991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a77c1b5-c3d5-4cdc-940b-bd70bf5c8cc7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:54.261121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 871/1714] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:54 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:54.265825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:54.287425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13c268-2d53-4e37-a1e4-8aaed6ae003b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.298536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:54.299248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.299455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.299727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] PATH_INFO: `/v3/projects/540a11f4d798492a983bb08f5551d5d7/users/a6a4bef7ffdc42bfa2078d2966f51581/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.307481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:54.335779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] RBAC: Authorizing `identity:create_grant(project_id=540a11f4d798492a983bb08f5551d5d7, user_id=a6a4bef7ffdc42bfa2078d2966f51581, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:54.338712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:54.366216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 844/1715] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:54 2022] PUT /identity/v3/projects/540a11f4d798492a983bb08f5551d5d7/users/a6a4bef7ffdc42bfa2078d2966f51581/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:54.377429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.377757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.378013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.436518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] MFA Rules not processed for user `a6a4bef7ffdc42bfa2078d2966f51581`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:54.437795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:54.586693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 872/1716] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:54.592224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:54.776870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e53b7c5-3a66-4273-af07-df21682b902f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.789589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:54.790460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.791043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.791443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.792366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:54.794925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8394-ab85-4e8d-9340-3250f3295345 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:54.866879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 845/1717] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:54 2022] POST /identity/v3/projects => generated 377 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:54.870975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:54.895390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24185f-66ed-4874-8698-f678c9dd6afd None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:54.971527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22505-0307-46ed-817b-e92d806de1fc None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.971864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22505-0307-46ed-817b-e92d806de1fc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.972865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f22505-0307-46ed-817b-e92d806de1fc None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:54.974457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 846/1718] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:53:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:53:54.992874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:54.993095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:54.993643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.052478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:55.053922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:55.071709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:55.176431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.178330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.179241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.181455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.196188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.210473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.293643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 847/1719] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:53:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:55.299155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:55.302205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 873/1720] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:54 2022] POST /identity/v3/users => generated 289 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:55.306192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:55.306597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:55.351573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55cf44-2c78-4f95-88b6-f0f86de42f15 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:55.364007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.364728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.365668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.366850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] PATH_INFO: `/v3/users/b0698ddb5e644183acc33f9d581db93d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.369132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a9b95-107e-4c2a-a4c4-b94299b924ec admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:55.370377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0698ddb5e644183acc33f9d581db93d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.378223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.395332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.400962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.404230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.405819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.407471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.424410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.463960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 874/1721] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:55.463960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:55.472727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:55.538264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be4ea6-bd75-40a2-b9c1-a2db15a4703c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:55.556527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.558466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.562880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.563162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.564609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0698ddb5e644183acc33f9d581db93d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:55.586324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0698ddb5e644183acc33f9d581db93d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:55.591002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.594672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:55.596848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.622017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0698ddb5e644183acc33f9d581db93d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:55.622801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0698ddb5e644183acc33f9d581db93d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:55.625393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 875/1722] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:55.626495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:55.644150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0698ddb5e644183acc33f9d581db93d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:55.663102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647c4d4-6f5b-4f6a-a8d9-cbe955dcda82 service placement] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:55.665706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 848/1723] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:55 2022] DELETE /identity/v3/users/b0698ddb5e644183acc33f9d581db93d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:55.827965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.828612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.829056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.829671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.830547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.832450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7b289-2eae-434a-9823-7ca6ec8c55a4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.855572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 876/1724] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:55.860368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:55.861851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:55.881686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e2352-6573-490c-9279-473c83080515 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:55.891522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:55.892440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.892888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.893460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] PATH_INFO: `/v3/projects/2ca5ae2fa14b42219d1f917fd5e4d06d/users/83dd3c7d7b8e4c87ac4b1819c25a29f5/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:55.947970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca5ae2fa14b42219d1f917fd5e4d06d, user_id=83dd3c7d7b8e4c87ac4b1819c25a29f5, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:55.950824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc237-b5ae-4bd1-88dc-33c548bd47fb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:55.969739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:55.970285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:55.970361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:56.009806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 849/1725] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:55 2022] PUT /identity/v3/projects/2ca5ae2fa14b42219d1f917fd5e4d06d/users/83dd3c7d7b8e4c87ac4b1819c25a29f5/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:56.011771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:56.014753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:56.015065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:56.060482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] MFA Rules not processed for user `dafa7108bd954266a90728b62ad68a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:56.064234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:56.100287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] MFA Rules not processed for user `83dd3c7d7b8e4c87ac4b1819c25a29f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:56.101535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:56.262367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 850/1726] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:56.267184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:56.345468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 877/1727] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:56.362791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:56.364271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:56.397059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a05a5c-9085-40b5-bde4-681671227d5f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:56.403472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:56.404097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:56.405045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:56.407864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:56.408717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:56.412323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:56.456682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 851/1728] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:56 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:53:56.457776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:56.461067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:56.463651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:56.537295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:56.561530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a35979-bf59-45ae-ae1b-6c7271bc6be7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:56.628874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41071606-f292-410b-8daa-8b03a2b769d9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:56.643183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:56.644189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:56.644701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:56.646058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] PATH_INFO: `/v3/projects/dbdce23c85fb4f3a8a9dc8b78503f146` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:56.648534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbdce23c85fb4f3a8a9dc8b78503f146)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:56.653212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:56.739770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:56.740417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:56.740701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:56.740978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:56.749367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbdce23c85fb4f3a8a9dc8b78503f146', 'request_id': 'req-b67387ed-6d4a-48b6-8279-819060a1b82a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:56.768061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbdce23c85fb4f3a8a9dc8b78503f146', 'request_id': 'req-b67387ed-6d4a-48b6-8279-819060a1b82a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:56.779086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbdce23c85fb4f3a8a9dc8b78503f146', 'request_id': 'req-b67387ed-6d4a-48b6-8279-819060a1b82a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:56.812154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] The token cache is being invalidate because project dbdce23c85fb4f3a8a9dc8b78503f146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:56.814597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:56.816890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:56.827494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 852/1729] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:56 2022] DELETE /identity/v3/projects/dbdce23c85fb4f3a8a9dc8b78503f146 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:56.829322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:56.836462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:56.875947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:56.877649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:56.907974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 878/1730] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:53:56.911871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:56.953356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640bcc7-66f9-4f00-80d8-bf9e9a312786 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:57.052574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67387ed-6d4a-48b6-8279-819060a1b82a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:57.062874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:57.064335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:57.065491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:57.065491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:57.070994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:57.076501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:57.155932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:57.156601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:57.157598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:57.157598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] PATH_INFO: `/v3/users/714a718936824cd6969d66b5271a626c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:57.161148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714a718936824cd6969d66b5271a626c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:57.163215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:57.172405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:57.239184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 853/1731] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:56 2022] POST /identity/v3/users => generated 296 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:57.244475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:57.313929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340bc889-4471-4207-8999-9587f06c1612 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:57.336845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:57.338955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:57.339235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:57.339613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:57.343639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:57.348711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:57.376473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714a718936824cd6969d66b5271a626c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:57.386146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 854/1732] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:57.392404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:57.408341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714a718936824cd6969d66b5271a626c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:57.409547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714a718936824cd6969d66b5271a626c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:57.426626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be3d92-327b-4445-8284-fa534d01e853 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:57.447874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:57.449672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:57.449997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:57.450400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] PATH_INFO: `/v3/projects/3d435fb174f247119105be02d9784989/users/98ffd1c601f04903a148fdac76d21384/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:57.457951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714a718936824cd6969d66b5271a626c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:57.493483 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714a718936824cd6969d66b5271a626c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:57.516018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 879/1733] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:56 2022] DELETE /identity/v3/users/714a718936824cd6969d66b5271a626c => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:57.520881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d435fb174f247119105be02d9784989, user_id=98ffd1c601f04903a148fdac76d21384, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:57.531490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:57.598544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 855/1734] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:57 2022] PUT /identity/v3/projects/3d435fb174f247119105be02d9784989/users/98ffd1c601f04903a148fdac76d21384/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:57.599930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:57.601518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:57.867234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030f44e-bec1-468a-8fec-52ab2f5db950 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:58.211628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:58.213042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:58.213442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:58.213900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:58.216812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:58.220369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da14022f-4d16-47c6-a995-7432cdf671ab admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:58.251445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 880/1735] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 650 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:53:58.252712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:58.287679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6586e6f-c6e8-4536-95e6-56cbee50f6e5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:58.303114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:58.304505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:58.304651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:58.304937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] PATH_INFO: `/v3/projects/3d435fb174f247119105be02d9784989/users/98ffd1c601f04903a148fdac76d21384/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:58.307281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d435fb174f247119105be02d9784989, user_id=98ffd1c601f04903a148fdac76d21384, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:58.310090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:58.318480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:58.344390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 856/1736] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:53:58 2022] PUT /identity/v3/projects/3d435fb174f247119105be02d9784989/users/98ffd1c601f04903a148fdac76d21384/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:58.346794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:58.346921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:58.347502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:58.439350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:58.441703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:58.454943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] MFA Rules not processed for user `98ffd1c601f04903a148fdac76d21384`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:58.456415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:58.492353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:58.672237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 881/1737] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:58.684514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7e3755-64b3-41bf-a468-af5b429c8117 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:58.700296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:58.700860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:58.701218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:58.701506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] PATH_INFO: `/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:58.706998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa9f18e1e62a4f5a9e0fea437b1af53f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:58.707360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:58.710639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:58.714004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:58.751266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753d99d3-7443-478b-ba6f-fade14ea0895 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:58.764214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:58.765168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:58.765459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:58.765737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] PATH_INFO: `/v3/users/8246970a787941ba950622c8497ddb63` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:58.769585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8246970a787941ba950622c8497ddb63)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:58.777202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:58.893179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa9f18e1e62a4f5a9e0fea437b1af53f', 'request_id': 'req-892ec7d7-3ff7-4024-b88d-85234edb67bf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.901074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8246970a787941ba950622c8497ddb63'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.927509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa9f18e1e62a4f5a9e0fea437b1af53f', 'request_id': 'req-892ec7d7-3ff7-4024-b88d-85234edb67bf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.938921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8246970a787941ba950622c8497ddb63'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.939791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8246970a787941ba950622c8497ddb63'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.947482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa9f18e1e62a4f5a9e0fea437b1af53f', 'request_id': 'req-892ec7d7-3ff7-4024-b88d-85234edb67bf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:58.991529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8246970a787941ba950622c8497ddb63'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:59.002494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] The token cache is being invalidate because project aa9f18e1e62a4f5a9e0fea437b1af53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:53:59.004221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:59.005026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:59.009038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 857/1738] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:53:58 2022] DELETE /identity/v3/projects/aa9f18e1e62a4f5a9e0fea437b1af53f => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:53:59.009961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.014581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.016547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3b294345-2738-43f1-b8e9-f69f915f4c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8246970a787941ba950622c8497ddb63'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:53:59.038287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 882/1739] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:53:58 2022] DELETE /identity/v3/users/8246970a787941ba950622c8497ddb63 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:53:59.040679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202ec8-8f01-465a-ab4d-e789db11ab7f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.040976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202ec8-8f01-465a-ab4d-e789db11ab7f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.041258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19202ec8-8f01-465a-ab4d-e789db11ab7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.112858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-19202ec8-8f01-465a-ab4d-e789db11ab7f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:59.113978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-19202ec8-8f01-465a-ab4d-e789db11ab7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.198462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ec7d7-3ff7-4024-b88d-85234edb67bf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.304568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 883/1740] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:59.304568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972086c-5853-41e4-a348-d9759342feb7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.304568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972086c-5853-41e4-a348-d9759342feb7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.304568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972086c-5853-41e4-a348-d9759342feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.326485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5972086c-5853-41e4-a348-d9759342feb7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:59.328634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5972086c-5853-41e4-a348-d9759342feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.342625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:59.354120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 884/1741] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:59.355734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.356380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.357438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.359611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.361545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.363728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.364956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.365287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.394828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:53:59.396493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.409036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 885/1742] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:53:59.412014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.426199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ed479-1bd5-467f-ad33-4377c63ea053 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.456862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.457891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.458438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.458875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.460899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:53:59.461443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.463483 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:59.476048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:59.503588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 886/1743] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:53:59.504791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.550530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0c199-46f4-45bd-8248-12aff4a305e8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.557177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.557846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.558155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.558431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.559078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.562883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.563376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:59.570431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:59.597149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 858/1744] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:59.598637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.600191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:53:59.618034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 887/1745] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:53:59 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:59.623393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.721173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cbe4c-7a36-477f-9a7e-635dec257836 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.798469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1100ca3c-a45c-43d3-b631-9d3d79eac8f7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.814790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.815586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.815902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.816181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.816937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.819720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:59.840444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.841131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.841417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.843328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.872075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.876083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 888/1746] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:53:59 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:53:59.876083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.876799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:53:59.910959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 859/1747] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:53:59.913425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:53:59.937635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb50f1-ec0e-42a4-94e9-f20fc26348d1 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:53:59.950060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:53:59.953073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:53:59.954279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:53:59.954805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:53:59.955862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:53:59.976379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:00.018190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 860/1748] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:00.022476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:00.060105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8beef5-22f6-4a2e-801e-84fee4152257 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:00.060915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a11053-8cad-43ff-9b8d-2b8527a5315f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:00.081602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:00.081965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:00.082625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.083445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.083807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.084137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.085219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.085944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.086726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:00.089836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.091221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:00.116666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 861/1749] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:00.118401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:00.137824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5632d366-aa2d-4ef5-85b7-0646030a2959 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:00.148322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:00.150432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.152066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.152352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] PATH_INFO: `/v3/projects/217f584268934c2eadc6f92e645c0dd8/users/c6d9081e96164166b1eacd0f37fd0760/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.196329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217f584268934c2eadc6f92e645c0dd8, user_id=c6d9081e96164166b1eacd0f37fd0760, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:00.199855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b91957d-f11e-4e8d-a102-9575c8067338 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:00.235500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 862/1750] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:00 2022] PUT /identity/v3/projects/217f584268934c2eadc6f92e645c0dd8/users/c6d9081e96164166b1eacd0f37fd0760/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:00.239922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:00.241445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:00.246339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad6a8-7b34-48ce-9452-ec8c569a5d2c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.246667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad6a8-7b34-48ce-9452-ec8c569a5d2c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.247027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ad6a8-7b34-48ce-9452-ec8c569a5d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.275934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 889/1751] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:53:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:00.291050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:00.300379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-116ad6a8-7b34-48ce-9452-ec8c569a5d2c None None] MFA Rules not processed for user `c6d9081e96164166b1eacd0f37fd0760`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:00.302115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-116ad6a8-7b34-48ce-9452-ec8c569a5d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.415250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 863/1752] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:00.419813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:00.436451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0363b3c-a994-4f2b-ba22-ef6377b16384 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:00.441626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93252ab-fc5c-48f7-b4d0-84d6687b6ea2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.441626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93252ab-fc5c-48f7-b4d0-84d6687b6ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.441919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93252ab-fc5c-48f7-b4d0-84d6687b6ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.499024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d93252ab-fc5c-48f7-b4d0-84d6687b6ea2 None None] MFA Rules not processed for user `8635a72ff3f74b6c89b841a2fcefbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:00.500018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:00.500331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d93252ab-fc5c-48f7-b4d0-84d6687b6ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.608873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:00.609096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.609455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.609635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.610345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:00.615259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77729fde-4ae1-454e-89c5-4371a2e8c2ab admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:00.652008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 864/1753] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:00.662426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.662717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.662997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.694075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 890/1754] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/projects => generated 371 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:00.696024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:00.696466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:00.696926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:00.721694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] MFA Rules not processed for user `2bb7b228b1b34b27bdb83357eef526c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:00.723507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.738911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] MFA Rules not processed for user `8635a72ff3f74b6c89b841a2fcefbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:00.742609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.863276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 891/1755] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:00.868738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:00.892514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 865/1756] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:00.893593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:00.907499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:00.959959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:01.032884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994b1c9-f3d6-49ef-b7dc-f91c6839da7f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.044202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.044967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.045252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.045530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.047454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.052872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.100223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89868-032c-4a6b-b64f-b8bde908532a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.122010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 892/1757] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:00 2022] POST /identity/v3/users => generated 292 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:01.123020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.131280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.131826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.132110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.132388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.134882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:01.176026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.177731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.182971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceac62e-6e63-4628-a058-5d5f0e367435 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.208264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.208894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.209178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.209452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.215181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 866/1758] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:01.216135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.236519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.239947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.243079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c4185-26b8-42e9-84be-7582d7f927b5 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.259276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.259964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.260191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.260466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.261122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.266156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.287773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 893/1759] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:01.319344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.321525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 867/1760] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:01.343882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0802b-88a3-4134-825e-e40a72bdc847 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.377209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.383417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.384050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.384492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] PATH_INFO: `/v3/projects/40273961ee1a474eb8c9421e030ec235/users/37e9f08930a149eb82c91c79513e6a02/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.435019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] RBAC: Authorizing `identity:create_grant(project_id=40273961ee1a474eb8c9421e030ec235, user_id=37e9f08930a149eb82c91c79513e6a02, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.442756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.477621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 894/1761] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:01 2022] PUT /identity/v3/projects/40273961ee1a474eb8c9421e030ec235/users/37e9f08930a149eb82c91c79513e6a02/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:01.481894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.502798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca39b9-f93d-47de-bb7d-d0ba07cc7dec admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.661656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.662719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.663032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.663311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.663973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.671116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bdb65c-d438-4a4e-aa04-f50b498cbd94 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.699518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 868/1762] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:01.700883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.711922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:01.723402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fa6a9c-5167-4055-b78e-6b51306f910a admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:01.734422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:01.735977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.736992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.737938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] PATH_INFO: `/v3/projects/40273961ee1a474eb8c9421e030ec235/users/37e9f08930a149eb82c91c79513e6a02/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.740592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40273961ee1a474eb8c9421e030ec235, user_id=37e9f08930a149eb82c91c79513e6a02, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:01.744234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:01.769109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 895/1763] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:01 2022] PUT /identity/v3/projects/40273961ee1a474eb8c9421e030ec235/users/37e9f08930a149eb82c91c79513e6a02/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:01.781646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d9d-6f60-402c-a1f0-04fb1d171b59 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.782014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d9d-6f60-402c-a1f0-04fb1d171b59 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.782406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d6d9d-6f60-402c-a1f0-04fb1d171b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:01.825393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-685d6d9d-6f60-402c-a1f0-04fb1d171b59 None None] MFA Rules not processed for user `37e9f08930a149eb82c91c79513e6a02`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:01.826819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-685d6d9d-6f60-402c-a1f0-04fb1d171b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:01.918927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 869/1764] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:01.936372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:01.977861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:01.978177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:01.978462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:02.045511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:02.051581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] MFA Rules not processed for user `5cc7c221754b4488adff9b193e8e0eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:02.052827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:02.063804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7269a8e2-bfa8-4849-bb9c-02d81a78a7b4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:02.067632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:02.068257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:02.068541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:02.068953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:02.094541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:02.096152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08617b-a456-47df-a132-0d21bf854ed2 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:02.119672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 896/1765] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:02.198555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 870/1766] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:02.200003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:02.200661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:02.200661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:02.247163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] MFA Rules not processed for user `5cc7c221754b4488adff9b193e8e0eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:02.248599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:02.264908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 897/1767] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:02.290781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:02.346751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:02.348473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:02.374946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03bdc44-7a8e-464c-b4e4-3f49b4f74322 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:02.401877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:02.402537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:02.402825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:02.403098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:02.488474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a60d6-8fa9-4936-a595-eb82f173bcfb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:02.525092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:02.528189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:02.528483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:02.531147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:02.555814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:02.557455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94449c31-4edc-412d-9432-2ae8ee05102a service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:02.563909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:02.571664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:02.580000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 871/1768] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:02.629967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 898/1769] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:03.056669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271a2e6-7e19-4942-baae-5030ee1e6a8c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.058447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271a2e6-7e19-4942-baae-5030ee1e6a8c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.062388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271a2e6-7e19-4942-baae-5030ee1e6a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.111589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c271a2e6-7e19-4942-baae-5030ee1e6a8c None None] MFA Rules not processed for user `dafa7108bd954266a90728b62ad68a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:03.113356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c271a2e6-7e19-4942-baae-5030ee1e6a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.225145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 872/1770] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:03.243869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:03.247228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.288461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7dd98-276e-431d-8b58-5e05c06209c6 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.290140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7dd98-276e-431d-8b58-5e05c06209c6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.290444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db7dd98-276e-431d-8b58-5e05c06209c6 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.292121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 873/1771] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 01:54:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:54:03.301695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.302031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.302321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.411697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:03.414861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.429038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33702499-cea7-4b6a-aef0-1fe7e112f150 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:03.442328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:03.442999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.443279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.443552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] PATH_INFO: `/v3/projects/dba3c72a4bd84e66a1903a221aacc60a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.447009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:03.449210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dba3c72a4bd84e66a1903a221aacc60a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:03.454036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:03.556151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:03.560726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 874/1772] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:54:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 16 01:54:03.575142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:03.591732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecbd0b-79c9-433e-a51d-bedc499f63b7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:03.606135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dba3c72a4bd84e66a1903a221aacc60a', 'request_id': 'req-8add21c5-9146-4c11-a8a0-5b14315160c6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.648974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dba3c72a4bd84e66a1903a221aacc60a', 'request_id': 'req-8add21c5-9146-4c11-a8a0-5b14315160c6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.658026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dba3c72a4bd84e66a1903a221aacc60a', 'request_id': 'req-8add21c5-9146-4c11-a8a0-5b14315160c6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.674214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] The token cache is being invalidate because project dba3c72a4bd84e66a1903a221aacc60a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:03.675282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.676101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8add21c5-9146-4c11-a8a0-5b14315160c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.678540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 899/1773] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:03 2022] DELETE /identity/v3/projects/dba3c72a4bd84e66a1903a221aacc60a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:03.680695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.681385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.681714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.684201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 900/1774] 10.222.0.33 () {54 vars in 912 bytes} [Fri Sep 16 01:54:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:54:03.684741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:03.688276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.740657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:03.741482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.741989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.742403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.744599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.763349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:03.767238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cf819-76de-46ef-a288-358b9f953555 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:03.783421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 875/1775] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:03.784719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.785007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.785284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.841166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417e4a5-340f-4feb-989c-37ddd9313394 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:03.848849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:03.849663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.849984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.850403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] PATH_INFO: `/v3/users/c053da59250d48e88644bca1c5a13218` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.851626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c053da59250d48e88644bca1c5a13218)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:03.852003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:03.853252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.853547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:03.860617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 876/1776] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:54:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:03.878964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:03.881919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:03.900581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0107e0-3ce7-4450-84d5-fccea96d2ba3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:03.905547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:03.906470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:03.907682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:03.908173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:03.925284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:03.928269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:03.940496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c053da59250d48e88644bca1c5a13218'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.959963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c053da59250d48e88644bca1c5a13218'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:03.960179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 877/1777] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:03.960689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c053da59250d48e88644bca1c5a13218'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:04.003891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c053da59250d48e88644bca1c5a13218'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:04.027603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c053da59250d48e88644bca1c5a13218'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:04.058496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 901/1778] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:03 2022] DELETE /identity/v3/users/c053da59250d48e88644bca1c5a13218 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:04.787961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:04.789454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.001738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:05.003473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.015371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e69f57-ef5f-445e-b8af-1a6f9d23651d service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:05.096241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:05.127808 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:05.148231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:05.150134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.150515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.151068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.153681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.168382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364336d8-6084-40c7-ace9-ea8ed902e3e5 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:05.176334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:05.187122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:05.193710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:05.194617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.195044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.195461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] PATH_INFO: `/v3/users/a6a4bef7ffdc42bfa2078d2966f51581` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.197202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a4bef7ffdc42bfa2078d2966f51581)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:05.199321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:05.240610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 878/1779] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:05.248003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:05.250229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.285448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d085159-4977-4918-a774-ca1864972fe5 service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:05.329500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:05.332955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.334439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.334730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] PATH_INFO: `/v3/projects/76ca0041462942ada1eeffcc2dac0155` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.347371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ca0041462942ada1eeffcc2dac0155)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:05.353770 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:05.361782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a4bef7ffdc42bfa2078d2966f51581'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.381922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a4bef7ffdc42bfa2078d2966f51581'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.382884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a4bef7ffdc42bfa2078d2966f51581'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.405542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a4bef7ffdc42bfa2078d2966f51581'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.419182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f12dccb9-942e-4ab3-81bf-f04a08b04384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a4bef7ffdc42bfa2078d2966f51581'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.443775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 902/1780] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:05 2022] DELETE /identity/v3/users/a6a4bef7ffdc42bfa2078d2966f51581 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:05.446772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bec4e-abb7-482c-87ef-794f4b60fd9e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.447634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bec4e-abb7-482c-87ef-794f4b60fd9e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.448771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623bec4e-abb7-482c-87ef-794f4b60fd9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.538356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ca0041462942ada1eeffcc2dac0155', 'request_id': 'req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.539703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-623bec4e-abb7-482c-87ef-794f4b60fd9e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:05.555365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-623bec4e-abb7-482c-87ef-794f4b60fd9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.577362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ca0041462942ada1eeffcc2dac0155', 'request_id': 'req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.587574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ca0041462942ada1eeffcc2dac0155', 'request_id': 'req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.622414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] The token cache is being invalidate because project 76ca0041462942ada1eeffcc2dac0155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:05.623806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.625645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9f0d7d4d-86e5-4ec6-baac-9f237aec8850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:05.628928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 879/1781] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:05 2022] DELETE /identity/v3/projects/76ca0041462942ada1eeffcc2dac0155 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:05.631823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64ae4-7fbb-4448-b493-2e51c0af9573 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.631969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64ae4-7fbb-4448-b493-2e51c0af9573 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.632233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e64ae4-7fbb-4448-b493-2e51c0af9573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.764683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b5e64ae4-7fbb-4448-b493-2e51c0af9573 None None] MFA Rules not processed for user `5cc7c221754b4488adff9b193e8e0eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:05.770689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5e64ae4-7fbb-4448-b493-2e51c0af9573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.793781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 903/1782] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:05.793781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.793781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.793781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:05.858116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:05.860056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.882893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 904/1783] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:05.883642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:05.887659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:05.943766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 880/1784] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:05 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:05.945837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:05.946150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:05.946426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.022313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:06.029221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:06.057677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 881/1785] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:06.058826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.071821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:06.079002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004609f-9dbf-444f-9765-07d9338411e5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.083928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.084738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.085056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.085279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.103054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cddbb-2ea0-40e0-8b08-127ce35e8929 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.106690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.112722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.123849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.129180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 905/1786] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:06.131265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.132667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.133795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.137756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:06.138462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.142942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.184004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 882/1787] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:06.187369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.199833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6905cd62-7629-4882-9af5-41af240d9c32 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.218562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.218562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.218562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.218562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.219831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.224991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.329183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.329374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 906/1788] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:06 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:06.370884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de36e53-9994-4e28-ac6f-45538b9bd189 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.502466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:06.527165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.528493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.530325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.530747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.533630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.537279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.601345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 883/1789] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:06 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:06.603217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.624026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659b0317-7202-4dc2-ac3b-2bc0da25f2db admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.637120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.638909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.639347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.639766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.640566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.642362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.668847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 907/1790] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:06.673508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.690451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d844e1-da43-47dd-b12f-ef6f27c5d7c1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.705664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.708109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.708419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.708702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.712166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.716513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e4d30-ab62-4ed2-8773-b40142660fe8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.765993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 884/1791] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:06.767491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:06.789022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2b930-5fa9-438a-87b2-38b2b0358779 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:06.819040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:06.821774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.822202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.822391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] PATH_INFO: `/v3/projects/65629b061f2f4e668e8e98182952bb1b/users/6313487b9b4d47aeb4d6580ceef9f9ae/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:06.869710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65629b061f2f4e668e8e98182952bb1b, user_id=6313487b9b4d47aeb4d6580ceef9f9ae, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:06.873685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:06.911131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 908/1792] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:06 2022] PUT /identity/v3/projects/65629b061f2f4e668e8e98182952bb1b/users/6313487b9b4d47aeb4d6580ceef9f9ae/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:06.914231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:06.914548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:06.915193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:07.019061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] MFA Rules not processed for user `6313487b9b4d47aeb4d6580ceef9f9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:07.024222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:07.285722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 885/1793] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:06 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:07.290685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:07.459421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b87210-4a04-42ad-8469-d4e5f89c4a28 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:07.469849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:07.470515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:07.470795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:07.471064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:07.471709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:07.474355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:07.555332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 909/1794] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:07 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:07.557097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:07.589350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade9af15-7ca1-44e6-9cea-166ae2056317 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:07.729719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:07.731942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:07.732819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:07.733196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:07.734184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:07.736289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152b16a-4470-4706-8bda-258dac0816e2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:07.832976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 886/1795] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:07 2022] POST /identity/v3/users => generated 300 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:07.836993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:07.852993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baff87-1c92-4119-9b48-dce0790d6ffa admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:07.866331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:07.866935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:07.867392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:07.867884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:07.869004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:07.874303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:07.893402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:07.893685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:07.893996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:07.940972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 910/1796] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:07.944004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:07.958046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] MFA Rules not processed for user `2bb7b228b1b34b27bdb83357eef526c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:07.958992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:07.984028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03aeea-ad41-44e3-8329-0d99fd0866b1 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:08.002630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:08.003335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.003616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.005509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] PATH_INFO: `/v3/projects/cb9d1e123b404ae49431d219d73ec560/users/91b38a1638e2472187d718cd398aaa64/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.096535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9d1e123b404ae49431d219d73ec560, user_id=91b38a1638e2472187d718cd398aaa64, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:08.101429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:08.136232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:08.142084 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 911/1797] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:07 2022] PUT /identity/v3/projects/cb9d1e123b404ae49431d219d73ec560/users/91b38a1638e2472187d718cd398aaa64/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:08.145475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:08.149168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:08.168317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 887/1798] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:08.170126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:08.203493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54aa55c-ab94-4d43-969e-6cfd498f5005 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:08.253811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:08.300473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499040a0-fcad-464d-abe6-d6ad4adc6260 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:08.305714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:08.306691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.307134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.307568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] PATH_INFO: `/v3/projects/540a11f4d798492a983bb08f5551d5d7` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.309002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=540a11f4d798492a983bb08f5551d5d7)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:08.311628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:08.415359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:08.417293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.418065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.419577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.420454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:08.422355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:08.460234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 888/1799] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:08.461170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:08.491396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '540a11f4d798492a983bb08f5551d5d7', 'request_id': 'req-92429f64-2445-4f41-be69-bfc99f489dd6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.501414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '540a11f4d798492a983bb08f5551d5d7', 'request_id': 'req-92429f64-2445-4f41-be69-bfc99f489dd6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.509395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '540a11f4d798492a983bb08f5551d5d7', 'request_id': 'req-92429f64-2445-4f41-be69-bfc99f489dd6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.518025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e154a12-133e-4a5c-a2c0-93a548237bda admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:08.539339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] The token cache is being invalidate because project 540a11f4d798492a983bb08f5551d5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:08.539638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.540329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.542568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 912/1800] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:08 2022] DELETE /identity/v3/projects/540a11f4d798492a983bb08f5551d5d7 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:08.547344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:08.548808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:08.637830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92429f64-2445-4f41-be69-bfc99f489dd6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:08.661085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:08.661939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.667526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.670332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] PATH_INFO: `/v3/users/83dd3c7d7b8e4c87ac4b1819c25a29f5` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.675133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dd3c7d7b8e4c87ac4b1819c25a29f5)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:08.676121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:08.677168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.677585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.678072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] PATH_INFO: `/v3/projects/cb9d1e123b404ae49431d219d73ec560/users/91b38a1638e2472187d718cd398aaa64/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.678200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:08.682369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb9d1e123b404ae49431d219d73ec560, user_id=91b38a1638e2472187d718cd398aaa64, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:08.688230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01c9d-b39c-4d04-8bf4-bf64a47f5f4f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:08.730374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 889/1801] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:08 2022] PUT /identity/v3/projects/cb9d1e123b404ae49431d219d73ec560/users/91b38a1638e2472187d718cd398aaa64/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:08.742612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3441e-3997-4148-9603-d1d09250ef41 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:08.744695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3441e-3997-4148-9603-d1d09250ef41 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:08.746025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3441e-3997-4148-9603-d1d09250ef41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:08.846465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dd3c7d7b8e4c87ac4b1819c25a29f5'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.860329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cdf3441e-3997-4148-9603-d1d09250ef41 None None] MFA Rules not processed for user `91b38a1638e2472187d718cd398aaa64`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:08.866906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dd3c7d7b8e4c87ac4b1819c25a29f5'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.867664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dd3c7d7b8e4c87ac4b1819c25a29f5'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.869325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cdf3441e-3997-4148-9603-d1d09250ef41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:08.910356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dd3c7d7b8e4c87ac4b1819c25a29f5'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:08.917018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:08.952923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dd3c7d7b8e4c87ac4b1819c25a29f5'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:09.001982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 913/1802] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:08 2022] DELETE /identity/v3/users/83dd3c7d7b8e4c87ac4b1819c25a29f5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:09.083795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 890/1803] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:08 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:09.095231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:09.096753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:09.450004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff43765d-f78b-40f5-89a6-056ffdd3c615 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:09.464795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:09.468055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:09.470636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:09.471014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:09.632773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:09.636053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:09.672463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 914/1804] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:09.977909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:09.978468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:09.978700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:10.053178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:10.175399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:10.181829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:10.473209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 891/1805] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:54:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:10.792093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:10.811478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:11.068844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5ef73-ada9-446b-9099-951691bbb4be service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:11.085160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:11.087851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:11.088280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:11.088794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:11.110570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:11.112972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:11.147760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 915/1806] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:11.379111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:11.381331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:11.449805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:11.451656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:11.509335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:11.700999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f730cfc6-f4d1-4e31-9a13-09f497d33002 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:11.760058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:11.761353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0056e2bd-1631-430a-a700-b8a597ec5027 service swift] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:11.762915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:11.769489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:11.770829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] PATH_INFO: `/v3/projects/2ca5ae2fa14b42219d1f917fd5e4d06d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:11.774406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca5ae2fa14b42219d1f917fd5e4d06d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:11.782017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:11.782670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:11.784055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:11.784353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:11.784632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] PATH_INFO: `/v3/users/6313487b9b4d47aeb4d6580ceef9f9ae` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:11.785853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6313487b9b4d47aeb4d6580ceef9f9ae)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:11.787928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:11.988690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca5ae2fa14b42219d1f917fd5e4d06d', 'request_id': 'req-3b943354-2f42-4098-b894-0b136ccd93ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.009484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca5ae2fa14b42219d1f917fd5e4d06d', 'request_id': 'req-3b943354-2f42-4098-b894-0b136ccd93ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.017545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6313487b9b4d47aeb4d6580ceef9f9ae'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.040579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca5ae2fa14b42219d1f917fd5e4d06d', 'request_id': 'req-3b943354-2f42-4098-b894-0b136ccd93ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.046821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6313487b9b4d47aeb4d6580ceef9f9ae'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.048521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6313487b9b4d47aeb4d6580ceef9f9ae'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.101841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] The token cache is being invalidate because project 2ca5ae2fa14b42219d1f917fd5e4d06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:12.108845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.121358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.130719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6313487b9b4d47aeb4d6580ceef9f9ae'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.132834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 892/1807] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:11 2022] DELETE /identity/v3/projects/2ca5ae2fa14b42219d1f917fd5e4d06d => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:12.134880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:12.149109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:12.165301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2c61c880-7ac9-45be-b376-d35ae3886b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6313487b9b4d47aeb4d6580ceef9f9ae'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:12.183021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 916/1808] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:11 2022] DELETE /identity/v3/users/6313487b9b4d47aeb4d6580ceef9f9ae => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:12.189406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:12.189805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:12.192087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:12.198212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:12.300074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:12.301324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:12.436488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b943354-2f42-4098-b894-0b136ccd93ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:12.602672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 917/1809] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:12.741373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:12.742181 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:12.742385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:12.742669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] PATH_INFO: `/v3/users/98ffd1c601f04903a148fdac76d21384` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:12.750883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ffd1c601f04903a148fdac76d21384)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:12.752931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:13.004903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ffd1c601f04903a148fdac76d21384'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:13.066206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ffd1c601f04903a148fdac76d21384'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:13.115855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ffd1c601f04903a148fdac76d21384'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:13.134451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ffd1c601f04903a148fdac76d21384'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:13.170662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a7fdaf8a-5da2-4828-8058-81f3fb5901c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ffd1c601f04903a148fdac76d21384'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:13.208804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 893/1810] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:12 2022] DELETE /identity/v3/users/98ffd1c601f04903a148fdac76d21384 => generated 0 bytes in 1075 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:13.253206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:13.256122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:13.449217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:13.550293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3cd85-cc8e-4e6f-bdfd-a2cd38e17dde None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:13.717447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:13.718739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:13.719114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:13.719474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:13.724611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:13.858391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:13.861677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:13.875235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 918/1811] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:14.400137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:14.401175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:14.401486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:14.469113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:14.471827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:14.484882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 894/1812] 10.222.0.20 () {58 vars in 1015 bytes} [Fri Sep 16 01:54:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:14.527655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:14.529764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:14.560585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c8ef5-1a82-4888-8f77-8306ae97bf69 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:14.576271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:14.577248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:14.577930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:14.578477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:14.596443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:14.597904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e65f3-c39d-4b51-9355-f1fd3ab6259b service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:14.612760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 919/1813] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:15.196239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:15.197860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:15.233375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09586150-63ea-4979-8e5e-a74a0856e841 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:15.245149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:15.245838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:15.246178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:15.246656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] PATH_INFO: `/v3/users/a24019e24a1845c384e1b64fdb0c93f2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:15.252348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24019e24a1845c384e1b64fdb0c93f2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:15.254681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:15.351620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:15.418499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24019e24a1845c384e1b64fdb0c93f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:15.451070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24019e24a1845c384e1b64fdb0c93f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:15.494658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24019e24a1845c384e1b64fdb0c93f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:15.496578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24019e24a1845c384e1b64fdb0c93f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:15.539046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24019e24a1845c384e1b64fdb0c93f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:15.564938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 895/1814] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:15 2022] DELETE /identity/v3/users/a24019e24a1845c384e1b64fdb0c93f2 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:15.569458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:15.570112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:15.570112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:15.642910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:15.644192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:15.931502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 920/1815] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:15.983005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:15.986204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:15.994205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:15.996383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:16.049257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee05f8-7a56-4ff0-9f6c-fd34753afe71 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:16.106632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:16.112115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.112395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.112672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] PATH_INFO: `/v3/projects/3d435fb174f247119105be02d9784989` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.116229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d435fb174f247119105be02d9784989)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:16.125460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:16.218321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:16.252751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0a449-8a76-4525-bb75-62484b822862 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:16.272822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d435fb174f247119105be02d9784989', 'request_id': 'req-aa452455-64d5-4766-b800-62dee300bf1e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:16.296314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d435fb174f247119105be02d9784989', 'request_id': 'req-aa452455-64d5-4766-b800-62dee300bf1e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:16.307957 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d435fb174f247119105be02d9784989', 'request_id': 'req-aa452455-64d5-4766-b800-62dee300bf1e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:16.333654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] The token cache is being invalidate because project 3d435fb174f247119105be02d9784989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:16.335905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:16.336654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-aa452455-64d5-4766-b800-62dee300bf1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:16.343282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 921/1816] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:15 2022] DELETE /identity/v3/projects/3d435fb174f247119105be02d9784989 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:16.345157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0952-0f9e-4fea-9417-aaa8337f3330 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.345449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0952-0f9e-4fea-9417-aaa8337f3330 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.345790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd0952-0f9e-4fea-9417-aaa8337f3330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.383330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-97dd0952-0f9e-4fea-9417-aaa8337f3330 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:16.384594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-97dd0952-0f9e-4fea-9417-aaa8337f3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:16.417911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:16.420780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.421786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.422396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.424565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:16.523492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 922/1817] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:16.533097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.533439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.533723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.556367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:16.558285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:16.586348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 923/1818] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:16.591565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:16.612032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:16.613748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:16.619902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0102515-311a-44f2-babb-b1b2a670e306 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:16.639023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 896/1819] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:16.640835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:16.643286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.643582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.643864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.648184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:16.649844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:16.675606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:16.724929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 924/1820] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:16.726499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:16.738978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572de36-fc72-49fa-bc0d-f295c7252320 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:16.754516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:16.755155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:16.755441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:16.755879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:16.756544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:16.758812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:16.791692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:16.855682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 897/1821] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:16 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:16.860307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:16.877253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a418d57-0b5f-43e4-9513-a8de81a3a511 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.001972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.004214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.004690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.005158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.006923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.010574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.087537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 925/1822] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:16 2022] POST /identity/v3/users => generated 293 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:17.092121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.112135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a53c2-6b94-4bc8-a8d6-5988d688afc4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.128069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.129058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.129344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.129616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.136381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.138942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.203308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 898/1823] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:17.206281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.237154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc02707-24f2-48b6-9474-44084431137e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.257752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.260553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.261288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.263539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.264294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.268144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fb205-7763-4014-afb4-f4d9a3b08d4a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.294686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 926/1824] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:17.299066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.314546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833bdf6-f7f5-41c7-82f1-3cc4c84ffba0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.324172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.326531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.326904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.327239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] PATH_INFO: `/v3/projects/c3bbeb0749264ca9beafdd011df199d7/users/b483198b71eb454eb2f702eeff573ebe/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.360789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3bbeb0749264ca9beafdd011df199d7, user_id=b483198b71eb454eb2f702eeff573ebe, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.368029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.397597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 899/1825] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:17 2022] PUT /identity/v3/projects/c3bbeb0749264ca9beafdd011df199d7/users/b483198b71eb454eb2f702eeff573ebe/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:17.412573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.412971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.413316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.437200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:17.459630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.461381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:17.495347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] MFA Rules not processed for user `b483198b71eb454eb2f702eeff573ebe`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:17.501351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:17.672898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6def4245-520e-4963-8466-028aeb51dade admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.682842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.685169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.685420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.686016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] PATH_INFO: `/v3/projects/65629b061f2f4e668e8e98182952bb1b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.687403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65629b061f2f4e668e8e98182952bb1b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.689574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.698824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 927/1826] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:17.725308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.742202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a5f73-73bc-43f8-86db-bc8abc53775a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:17.767076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:17.767925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:17.768682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:17.769186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:17.770180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:17.775015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:17.829611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65629b061f2f4e668e8e98182952bb1b', 'request_id': 'req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:17.843659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65629b061f2f4e668e8e98182952bb1b', 'request_id': 'req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:17.855593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65629b061f2f4e668e8e98182952bb1b', 'request_id': 'req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:17.875954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] The token cache is being invalidate because project 65629b061f2f4e668e8e98182952bb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:17.876347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:17.877071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:17.881970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 900/1827] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:17 2022] DELETE /identity/v3/projects/65629b061f2f4e668e8e98182952bb1b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:17.883244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.885265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:17.885949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 928/1828] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:17 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:17.887385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:17.897058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:17.961772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:17.993697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c5e37-8178-426d-a3bf-ca8aa8cb4f86 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.173479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0c42a-2160-4b9b-b950-ae08e1f88877 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.196641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.197479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.197811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.199519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.206163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.207059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.207502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.207707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] PATH_INFO: `/v3/users/91b38a1638e2472187d718cd398aaa64` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.211574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.215625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:18.219786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91b38a1638e2472187d718cd398aaa64)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.225822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:18.319266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 929/1829] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:17 2022] POST /identity/v3/users => generated 299 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:18.330601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:18.379527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70699084-a8d2-4147-9d4b-27ed85d7dc8e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.406999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.407782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.408200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.408665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.409469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.411784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:18.412867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91b38a1638e2472187d718cd398aaa64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:18.425128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 930/1830] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:18.430910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:18.438507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91b38a1638e2472187d718cd398aaa64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:18.455615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358874-97d5-4d91-9191-1cea6fd08181 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.462470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.463442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.463910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.464366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] PATH_INFO: `/v3/projects/32bd19d0578d4da7ba59e77b4297716e/users/42d49281a4b2484faf5124036aaba5e8/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.483986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bd19d0578d4da7ba59e77b4297716e, user_id=42d49281a4b2484faf5124036aaba5e8, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.485483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91b38a1638e2472187d718cd398aaa64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:18.488600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91b38a1638e2472187d718cd398aaa64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:18.490071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:18.510353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 931/1831] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:18 2022] PUT /identity/v3/projects/32bd19d0578d4da7ba59e77b4297716e/users/42d49281a4b2484faf5124036aaba5e8/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:18.524741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91b38a1638e2472187d718cd398aaa64'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:18.532561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:18.540475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:18.556064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 901/1832] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:17 2022] DELETE /identity/v3/users/91b38a1638e2472187d718cd398aaa64 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:18.616077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:18.686824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d0b44-c473-4ee4-aeef-575b5aa1194a admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.827716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.829438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.830147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.830605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.831637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.862980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f245e4-38c4-4e5a-9baf-2d8354e95098 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:18.944338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:18.951399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 932/1833] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:18.960102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf51b79-cd2a-40a6-ba93-0b6fb46e9c20 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:18.975946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:18.976813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:18.977223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:18.977520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] PATH_INFO: `/v3/projects/32bd19d0578d4da7ba59e77b4297716e/users/42d49281a4b2484faf5124036aaba5e8/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:18.983740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32bd19d0578d4da7ba59e77b4297716e, user_id=42d49281a4b2484faf5124036aaba5e8, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:18.987273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:19.027152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:19.027526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:19.027934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:19.031654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 902/1834] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:18 2022] PUT /identity/v3/projects/32bd19d0578d4da7ba59e77b4297716e/users/42d49281a4b2484faf5124036aaba5e8/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:19.087405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] MFA Rules not processed for user `42d49281a4b2484faf5124036aaba5e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:19.089108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:19.246996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 933/1835] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:19 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:19.259201 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:19.267367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:19.497913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84246a71-ed15-45d4-bfbd-02bc39d63f39 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:19.526580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:19.527287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:19.527604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:19.527970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:19.541541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:19.572465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:19.762163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:19.763728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6ac0b-004d-4cea-bfbb-4a6e96f4d19b service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:19.778772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 903/1836] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:20.849916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:20.851578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:20.870179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848a54-458f-4f7f-9ee6-3907c407e918 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:20.870863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848a54-458f-4f7f-9ee6-3907c407e918 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:20.871588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74848a54-458f-4f7f-9ee6-3907c407e918 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:20.874545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 904/1837] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:54:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:54:20.937415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:20.937700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:20.938419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:21.057813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:21.067857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:21.125644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:21.140733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268ade5-4d10-4e97-88d4-06c85ba5be57 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:21.167193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:21.170285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:21.171231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:21.171590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] PATH_INFO: `/v3/projects/0a72137f57cd42ae91cac220cfc744a4` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:21.179989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a72137f57cd42ae91cac220cfc744a4)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:21.186001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:21.304333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a72137f57cd42ae91cac220cfc744a4', 'request_id': 'req-0b076964-e7a9-48d8-9a7e-491aee2cd0df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.315715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a72137f57cd42ae91cac220cfc744a4', 'request_id': 'req-0b076964-e7a9-48d8-9a7e-491aee2cd0df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.325462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a72137f57cd42ae91cac220cfc744a4', 'request_id': 'req-0b076964-e7a9-48d8-9a7e-491aee2cd0df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.330269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 905/1838] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:54:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:21.339706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] The token cache is being invalidate because project 0a72137f57cd42ae91cac220cfc744a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:21.340167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.341496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.345917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 934/1839] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:20 2022] DELETE /identity/v3/projects/0a72137f57cd42ae91cac220cfc744a4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:21.347705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:21.363901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b20613-67ca-4121-a758-4cf274e20cb7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:21.549858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:21.550547 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:21.550829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:21.551104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] PATH_INFO: `/v3/users/cc73aa96637d426db68de82b2a8a4a85` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:21.554920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc73aa96637d426db68de82b2a8a4a85)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:21.561017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:21.721002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:21.732395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc73aa96637d426db68de82b2a8a4a85'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.752443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc73aa96637d426db68de82b2a8a4a85'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.789424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc73aa96637d426db68de82b2a8a4a85'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.790209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc73aa96637d426db68de82b2a8a4a85'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.826920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-31d77a1a-756e-427a-9e08-236a3ca3859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc73aa96637d426db68de82b2a8a4a85'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:21.860727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 906/1840] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:21 2022] DELETE /identity/v3/users/cc73aa96637d426db68de82b2a8a4a85 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:22.090473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:22.092454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:22.454816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b076964-e7a9-48d8-9a7e-491aee2cd0df admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:22.722872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:22.724890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:22.725186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:22.726797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:22.737400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:22.783128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:22.784926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e54fb-b4fd-469b-a9bd-8231a849a2f0 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:22.822594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 935/1841] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:22.824158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:22.824774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:22.824774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:22.826389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 907/1842] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:54:22.880927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:22.880927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:22.880927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:22.921416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:22.927897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:22.953118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 936/1843] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:54:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:23.223879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:23.226524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:23.238048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:23.239879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:23.252066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:23.267905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83e713-a876-4bf1-bbe9-72a7a1b7dec9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:23.275716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:23.276640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:23.277101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:23.277565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:23.294000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:23.300729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab76314-e9ad-4b28-a141-e6d713313379 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:23.342952 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 937/1844] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:23.464330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d9803-25d9-40bf-b937-cc15d1799ab8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:23.478936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:23.481906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:23.484618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:23.484934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] PATH_INFO: `/v3/projects/cb9d1e123b404ae49431d219d73ec560` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:23.490259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb9d1e123b404ae49431d219d73ec560)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:23.499960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:23.609339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb9d1e123b404ae49431d219d73ec560', 'request_id': 'req-391168de-071c-4b6e-b42e-57f63475efa7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:23.621193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb9d1e123b404ae49431d219d73ec560', 'request_id': 'req-391168de-071c-4b6e-b42e-57f63475efa7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:23.632172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb9d1e123b404ae49431d219d73ec560', 'request_id': 'req-391168de-071c-4b6e-b42e-57f63475efa7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:23.648351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] The token cache is being invalidate because project cb9d1e123b404ae49431d219d73ec560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:23.648871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:23.657557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-391168de-071c-4b6e-b42e-57f63475efa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:23.660059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 908/1845] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:23 2022] DELETE /identity/v3/projects/cb9d1e123b404ae49431d219d73ec560 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:23.665063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:23.665606 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:23.666140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:23.768158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:23.770341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:23.948744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 938/1846] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:23.956449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:23.957617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:23.958158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.004534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:24.009349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.030612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 909/1847] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:24.035404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.056168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e57ef-60d0-4d6e-8a2f-3de2200a0967 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.068807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.069674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.070082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.071741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.071741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:24.073543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.075916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.113998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 939/1848] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:24.118386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.132182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fec0b-c272-469e-8a06-5408d217ef5b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.138918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.139744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.140125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.140583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.141399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.143576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.178121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 910/1849] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:24.183885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.207988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d4c4ea-d100-4b33-ae2a-b8256ce4b0e9 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.236432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.240444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.303800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.305123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.305633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.306147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.308127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.311699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.339001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:24.353039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 940/1850] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/users => generated 290 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:24.360188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.376898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54b87b-af77-4d22-a476-edc1776a073e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.382988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.383827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.384213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.384612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.385363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.388271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.410810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 941/1851] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:24.422154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.445502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d85c419-bcaf-4f33-99dc-0ec0a05f3e85 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.460280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.461107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.461392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.461667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] PATH_INFO: `/v3/projects/d1156f533f034629a2bff76489ae42a6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.462875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1156f533f034629a2bff76489ae42a6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.464788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.468474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a66fa2-1699-4ec3-a86a-503340431d51 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.488675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.489310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.490493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.490779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.491909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.493519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.518934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 942/1852] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:24.523054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.537478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d680b51-5c44-4742-8ec3-d7fead9001a3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.539945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1156f533f034629a2bff76489ae42a6', 'request_id': 'req-3724da26-7ea9-4825-91d0-bbb6aadc8834'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:24.550352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1156f533f034629a2bff76489ae42a6', 'request_id': 'req-3724da26-7ea9-4825-91d0-bbb6aadc8834'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:24.557829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1156f533f034629a2bff76489ae42a6', 'request_id': 'req-3724da26-7ea9-4825-91d0-bbb6aadc8834'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:24.574522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] The token cache is being invalidate because project d1156f533f034629a2bff76489ae42a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:24.574881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:24.575869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3724da26-7ea9-4825-91d0-bbb6aadc8834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:24.582418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 911/1853] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:24 2022] DELETE /identity/v3/projects/d1156f533f034629a2bff76489ae42a6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:24.584492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906fcd-62f1-4323-9100-303684fcfdc5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.584786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906fcd-62f1-4323-9100-303684fcfdc5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.585096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8906fcd-62f1-4323-9100-303684fcfdc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.604550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:24.613142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a8906fcd-62f1-4323-9100-303684fcfdc5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:24.615125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a8906fcd-62f1-4323-9100-303684fcfdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.620758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.621454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.621736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.622758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] PATH_INFO: `/v3/projects/5777f05191a74707ae3096e895d01a3b/users/97e3fa2de69b4e6393de95fa31940792/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.658426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 912/1854] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:24.664173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5777f05191a74707ae3096e895d01a3b, user_id=97e3fa2de69b4e6393de95fa31940792, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.666891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6b74f-f5fd-4a19-bb11-94b4f48acaa6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.671179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.671455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.671729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.709251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 943/1855] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:24 2022] PUT /identity/v3/projects/5777f05191a74707ae3096e895d01a3b/users/97e3fa2de69b4e6393de95fa31940792/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:24.720734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.721731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.722131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.725508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:24.731819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.770438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] MFA Rules not processed for user `97e3fa2de69b4e6393de95fa31940792`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:24.772630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.834030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 913/1856] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:24.839240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.853543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859582a5-21e4-405c-acaf-577bfb13daef None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.860339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.861771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.862186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.862554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.863367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:24.863929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.866319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.871737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 944/1857] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:24.876398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.878285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:24.881926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 914/1858] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:24.886827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.894801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d5fc7-ed10-4e08-8b03-e81b522fcc85 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.899753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.900480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27aa70d2-9c68-4e41-acf2-2e517c051526 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:24.901144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.901144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.901144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.901880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.904560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.907331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:24.908144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:24.908519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:24.908903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:24.909793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:24.912585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:24.944900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 945/1859] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:24.946396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.953655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 915/1860] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:24.957795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:24.974195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.022172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1e0cd-a2ae-4fa6-9285-e58bc883b5de admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.036298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9507-bc5c-4122-9e14-35dd3a74b242 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.041132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.041720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.042034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.042310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.042956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.044984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.072059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 916/1861] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:25.076439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.081427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.092169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100172d2-3829-48a9-bb89-3a0ae0288e45 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.098545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.099311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.099718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.099831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.100189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.100615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.100909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.101018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.101265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.102041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.103200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.104891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.118200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 917/1862] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:25.123438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.131759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 946/1863] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:24 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:25.135907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.136026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ba901-731a-4665-80fd-397ecaa48527 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.157906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a911390-52d7-48ec-b7db-cce88a915f1e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.158148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.158148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.158148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.158148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.158482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.158482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.160268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.160925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.161277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.161463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.162508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.164163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.175601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 947/1864] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:25.177033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 918/1865] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:25.179566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.182132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.191470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547152d-5e9e-4e24-ae3d-5f39e1fbf3a4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.197627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.197939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00817d-aab6-4fa0-b49d-25f8a62e9f76 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.198985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.199649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.201771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] PATH_INFO: `/v3/projects/03c421ac3bb54745a8f2c8fc837734fa/users/200f2d7d8991410186d9394f50aff03a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.204721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.205505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.206037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.206418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] PATH_INFO: `/v3/projects/473db8d46be04dab950c396001e0866c/users/e32a2e930d554284a40494743bfb90a4/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.223187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c421ac3bb54745a8f2c8fc837734fa, user_id=200f2d7d8991410186d9394f50aff03a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.226055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.234484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473db8d46be04dab950c396001e0866c, user_id=e32a2e930d554284a40494743bfb90a4, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.237204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521eec99-87aa-46f5-b0b5-01660b37fa07 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.247074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 948/1866] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:25 2022] PUT /identity/v3/projects/03c421ac3bb54745a8f2c8fc837734fa/users/200f2d7d8991410186d9394f50aff03a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:25.251127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.270803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 919/1867] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:25 2022] PUT /identity/v3/projects/473db8d46be04dab950c396001e0866c/users/e32a2e930d554284a40494743bfb90a4/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:25.281826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.282147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.282429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.332620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] MFA Rules not processed for user `e32a2e930d554284a40494743bfb90a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:25.333848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:25.365395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f3a3f-2296-494c-9a28-37fe1efdaaef admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.453485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 920/1868] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:25.458748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.467132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.469440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.469775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.471245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.473156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.475122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.483495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b37461a-1001-402a-ab32-bf10af71e0c6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.502427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 949/1869] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:25.507071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.507616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.507934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.508298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.508731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.509705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.513164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.523723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02371a4-39e0-4e13-9ddd-53192c90e4ed admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.532987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.534189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.534861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.535693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] PATH_INFO: `/v3/projects/03c421ac3bb54745a8f2c8fc837734fa/users/200f2d7d8991410186d9394f50aff03a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.538136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c421ac3bb54745a8f2c8fc837734fa, user_id=200f2d7d8991410186d9394f50aff03a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.541510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a3042-2661-42c6-8f3e-badaa432cd2f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.556999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 950/1870] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:25 2022] PUT /identity/v3/projects/03c421ac3bb54745a8f2c8fc837734fa/users/200f2d7d8991410186d9394f50aff03a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:25.569696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 921/1871] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:25 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:25.581909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.589042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.589330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.598011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.633243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.672835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] MFA Rules not processed for user `200f2d7d8991410186d9394f50aff03a`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:25.672835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:25.692700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.692926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f3252-2a2e-4ead-ac17-481cae961a59 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.701111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.702083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.702368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.703285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.703410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.705667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.741326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 922/1872] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:25 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:25.741326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.746549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:25.783157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 951/1873] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:25.785140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.798565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c1f28-63ad-4ac0-8122-f3e9261b4b4a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.803488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.804109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.804390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.804725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.805381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.807027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.821937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 952/1874] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:25.822715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.825792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:25.872922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526062ad-f1da-4158-92a7-5efc31e857c7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.878363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.879048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.879334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.879809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.882090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:25.898996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ddae8-be02-4282-a760-370a233d8d5e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.904326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.904950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.905337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.906244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:25.920361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:25.922249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:25.936429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 953/1875] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:25.936429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:25.948199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683046d6-35eb-4f31-943d-4c92b414555b service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:25.955171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:25.956057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:25.956615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:25.956895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] PATH_INFO: `/v3/projects/57ea106f0b414e2e9343f4f7fac880cb/users/c821da64a5b644e4b4e5c73126e597fa/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.000715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea106f0b414e2e9343f4f7fac880cb, user_id=c821da64a5b644e4b4e5c73126e597fa, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.003751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.004870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.007936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.025497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 923/1876] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:26.037084 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 954/1877] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:25 2022] PUT /identity/v3/projects/57ea106f0b414e2e9343f4f7fac880cb/users/c821da64a5b644e4b4e5c73126e597fa/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:26.040850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.064225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf5dfc-53fa-41a4-88a2-5c9fe13e23c8 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:26.149264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:26.149972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.150315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.150630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.151340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.153028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9aedc4-f66c-4690-bad8-3bff50a810bf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.160242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:26.171578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 924/1878] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:26 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:26.174691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.201532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3a6d3c-a565-4092-97a1-d222b64dfdc4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:26.214681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:26.216327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.216847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.217384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] PATH_INFO: `/v3/projects/57ea106f0b414e2e9343f4f7fac880cb/users/c821da64a5b644e4b4e5c73126e597fa/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.219521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57ea106f0b414e2e9343f4f7fac880cb, user_id=c821da64a5b644e4b4e5c73126e597fa, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.222305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.242875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 955/1879] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:26 2022] PUT /identity/v3/projects/57ea106f0b414e2e9343f4f7fac880cb/users/c821da64a5b644e4b4e5c73126e597fa/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:26.247145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3912-3f09-4001-a482-decc290c892e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.247760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3912-3f09-4001-a482-decc290c892e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.248288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68a3912-3f09-4001-a482-decc290c892e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.287658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a68a3912-3f09-4001-a482-decc290c892e None None] MFA Rules not processed for user `c821da64a5b644e4b4e5c73126e597fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:26.288897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a68a3912-3f09-4001-a482-decc290c892e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:26.383265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 925/1880] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:26 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:26.398295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.417635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a3912-3f09-4001-a482-decc290c892e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.473811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401afca5-6a3c-4dc3-9950-234c63f31a71 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:26.478171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:26.478828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.479139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.479419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.488563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68a3912-3f09-4001-a482-decc290c892e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:26.489981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.491902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.493492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:26.494706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.494706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.494901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] PATH_INFO: `/v3/users/97e3fa2de69b4e6393de95fa31940792` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.496028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97e3fa2de69b4e6393de95fa31940792)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.498690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.504185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 956/1881] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:26 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:26.605797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.623590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97e3fa2de69b4e6393de95fa31940792'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:26.629446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b109a-1aac-498b-92b4-59d2bb67fdd8 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:26.641649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:26.642800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.643505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.643869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.647713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97e3fa2de69b4e6393de95fa31940792'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:26.659004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:26.667611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97e3fa2de69b4e6393de95fa31940792'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:26.668335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97e3fa2de69b4e6393de95fa31940792'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:26.698341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6c056043-7ab7-4e3c-b908-74854ed2c568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97e3fa2de69b4e6393de95fa31940792'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:26.708786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 926/1882] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:26 2022] DELETE /identity/v3/users/97e3fa2de69b4e6393de95fa31940792 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:26.713626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:26.714222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:26.714683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:26.727516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:26.753792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:26.753792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:26.765275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:26.769125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:26.799987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 957/1883] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:26.865317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 927/1884] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:26.875741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:26.877135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:26.947044 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920cb55-83e7-4d37-8fb4-860f2ebf0d43 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:27.027714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:27.028677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:27.029006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:27.029348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:27.057269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:27.062714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:27.080104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 958/1885] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:28.143390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:28.144977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:28.160771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39592d6-d2e9-492e-9023-04c4dc7881bf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:28.165530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:28.166567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:28.166876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:28.167301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] PATH_INFO: `/v3/projects/5777f05191a74707ae3096e895d01a3b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:28.169289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5777f05191a74707ae3096e895d01a3b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:28.171269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:28.239061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5777f05191a74707ae3096e895d01a3b', 'request_id': 'req-69c70a2a-5739-4a24-854c-cc33c78e76d7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.261019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5777f05191a74707ae3096e895d01a3b', 'request_id': 'req-69c70a2a-5739-4a24-854c-cc33c78e76d7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.278790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5777f05191a74707ae3096e895d01a3b', 'request_id': 'req-69c70a2a-5739-4a24-854c-cc33c78e76d7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.309037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] The token cache is being invalidate because project 5777f05191a74707ae3096e895d01a3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:28.309423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.310148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.311694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 928/1886] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:28 2022] DELETE /identity/v3/projects/5777f05191a74707ae3096e895d01a3b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:28.318396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:28.335383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a139d38-8914-41ec-811e-c74f3d05436c service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:28.417899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:28.419151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:28.419551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:28.419904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] PATH_INFO: `/v3/users/200f2d7d8991410186d9394f50aff03a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:28.421949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] RBAC: Authorizing `identity:delete_user(user_id=200f2d7d8991410186d9394f50aff03a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:28.425170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:28.440261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:28.520778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200f2d7d8991410186d9394f50aff03a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.533374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200f2d7d8991410186d9394f50aff03a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.534188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200f2d7d8991410186d9394f50aff03a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.553915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200f2d7d8991410186d9394f50aff03a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.581902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b35e63ba-d2d5-4938-94e2-1b07b642711a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200f2d7d8991410186d9394f50aff03a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:28.589042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 959/1887] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:28 2022] DELETE /identity/v3/users/200f2d7d8991410186d9394f50aff03a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:29.039589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.040919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:29.061377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c70a2a-5739-4a24-854c-cc33c78e76d7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.174116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.174116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.174116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.174116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] PATH_INFO: `/v3/projects/03c421ac3bb54745a8f2c8fc837734fa` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.174891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c421ac3bb54745a8f2c8fc837734fa)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.174891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.229343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:29.247232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c421ac3bb54745a8f2c8fc837734fa', 'request_id': 'req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:29.276403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c421ac3bb54745a8f2c8fc837734fa', 'request_id': 'req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:29.285666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c421ac3bb54745a8f2c8fc837734fa', 'request_id': 'req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:29.304964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] The token cache is being invalidate because project 03c421ac3bb54745a8f2c8fc837734fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:29.304964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:29.305743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-4aba86b8-b0cb-46df-9f36-28a2d7c56c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:29.311606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 929/1888] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:29 2022] DELETE /identity/v3/projects/03c421ac3bb54745a8f2c8fc837734fa => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:29.313309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.313763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.314233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.343197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:29.344525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:29.431640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 960/1889] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:29.439932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.440220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.441027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.470649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:29.472309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:29.480751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 930/1890] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:29.485534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.496318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb852b-b40c-45b4-8b2a-28405c3eb7f2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.502036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.502724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.503078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.503522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.504259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:29.504630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.506371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dab54c-d9fe-4cc1-97fc-98b9effe5b13 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.522149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 961/1891] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:29.523263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.533309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effd4ad-dd1d-4a46-a363-65d1a8ab63b2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.538317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.538973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.539255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.539529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.540173 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.542102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.549414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3701d-2c76-4515-8d80-b9aeee6a98a6 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.549775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3701d-2c76-4515-8d80-b9aeee6a98a6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.550177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3701d-2c76-4515-8d80-b9aeee6a98a6 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.551969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 962/1892] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:54:29.563753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.564091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.565209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.576886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 931/1893] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:29.577402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.590917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:29.592227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:29.655403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805a36-dff5-4ef5-af49-46a3acbd3333 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.663864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.664574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.664934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.665280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.666062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.668576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.682179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 963/1894] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:29.697473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 932/1895] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/users => generated 288 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:29.699181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.711279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbbefc-a420-4b21-850e-c02a7de3a5d0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.716636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.717259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.717542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.717812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.718517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.720126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.721733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:29.740060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 964/1896] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:29.740888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.752589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f74560-effd-4683-890a-c9f553bf6e14 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.757743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.758447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.758713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.758988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.759687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.761314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.773023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 933/1897] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:29.776968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.787416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54901c72-89aa-4fa5-8491-610dff323859 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.792607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.794584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.794946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.795661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] PATH_INFO: `/v3/projects/5114398f1cd44a37bf685610186f53b8/users/21b321ee0a854831abeecbe59ebe7973/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.801123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:29.804620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:29.818810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5114398f1cd44a37bf685610186f53b8, user_id=21b321ee0a854831abeecbe59ebe7973, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.822702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1e783-b5ae-4f8c-82de-86c94004a8f5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.826134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee3681-3d26-4d64-bdb7-c76576b4d6ec admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:29.834590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:29.835346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.835895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.836280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.854953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 965/1898] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:29 2022] PUT /identity/v3/projects/5114398f1cd44a37bf685610186f53b8/users/21b321ee0a854831abeecbe59ebe7973/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:29.867742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:29.868213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:29.868713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:29.881981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:29.883606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:29.907649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 934/1899] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:29.916566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] MFA Rules not processed for user `21b321ee0a854831abeecbe59ebe7973`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:29.917993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:30.015361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 966/1900] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:30.019941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.039272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e24a8-553c-4a49-b491-e25a6a9e09a6 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.127100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:30.140707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.141032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.142502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.143758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.144408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.147048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.202741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 935/1901] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:30 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:30.206220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.223535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44155447-8837-408f-b7d3-bc5a5c136e4c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.345136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.347841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.349258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.349854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.352626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.356915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.405548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 967/1902] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:30 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:30.410018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.424712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74a5b1-f82a-45da-a9da-8742bb165e07 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.433205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.434035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.434355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.434663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.435350 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.451496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.481546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 936/1903] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:30.483337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.504391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fade436-f821-431f-bc1d-ee6b1b64ec11 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.511193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.512671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.513801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.514689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] PATH_INFO: `/v3/projects/e953f4bc2e704f4bb2597de829ad5385/users/d61b1728bcfb480296b587a3458d4d8c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.541210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953f4bc2e704f4bb2597de829ad5385, user_id=d61b1728bcfb480296b587a3458d4d8c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.548276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.571542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 968/1904] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:30 2022] PUT /identity/v3/projects/e953f4bc2e704f4bb2597de829ad5385/users/d61b1728bcfb480296b587a3458d4d8c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:30.572993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.589040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbdde97-7d8c-4b89-844a-ca3382b7727c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.717448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.718184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.718552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.718916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.720396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.723740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a0533-c86f-4c0e-8386-8c99e976b473 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.753938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 937/1905] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:30 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:30.754168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.756054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8742f9-8619-4e5a-9de3-c9950ecec542 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:30.760905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:30.761945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.762937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.763293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] PATH_INFO: `/v3/projects/e953f4bc2e704f4bb2597de829ad5385/users/d61b1728bcfb480296b587a3458d4d8c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.765423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953f4bc2e704f4bb2597de829ad5385, user_id=d61b1728bcfb480296b587a3458d4d8c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:30.768313 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:30.780157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 969/1906] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:30 2022] PUT /identity/v3/projects/e953f4bc2e704f4bb2597de829ad5385/users/d61b1728bcfb480296b587a3458d4d8c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:30.791723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:30.792079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:30.792425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:30.826608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] MFA Rules not processed for user `d61b1728bcfb480296b587a3458d4d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:30.828031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:30.926696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 938/1907] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:30.938502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:30.940854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:30.963095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:31.019585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead33b6-6f2f-428b-8368-f926a9d7defc admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:31.024809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:31.025640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.026837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.026837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.050962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:31.052694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:31.093656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:31.095153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c9dfe-d4f4-4572-b625-7a50b9578eab service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:31.105270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 970/1908] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:31.114779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:31.132868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed0a9c-9c61-4ae0-815e-bc4a6713738e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:31.142444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:31.143143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.143435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.143711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] PATH_INFO: `/v3/users/e32a2e930d554284a40494743bfb90a4` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.144881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32a2e930d554284a40494743bfb90a4)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:31.146984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:31.200926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32a2e930d554284a40494743bfb90a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.209961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32a2e930d554284a40494743bfb90a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.224730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32a2e930d554284a40494743bfb90a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.225792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32a2e930d554284a40494743bfb90a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.235117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32a2e930d554284a40494743bfb90a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.242108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 939/1909] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:31 2022] DELETE /identity/v3/users/e32a2e930d554284a40494743bfb90a4 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:31.246891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.247244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.247626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.268787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:31.270349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:31.355800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 971/1910] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:31.366522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:31.368005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:31.500638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f757cc-b10e-44dd-a6d3-4cf1083d9e15 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:31.506991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:31.507631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.507916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.508194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.526433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:31.528687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a7242a-457a-488b-bae8-88a7006a92d7 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:31.541674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 940/1911] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:31.577771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:31.579393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:31.598584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcf05a-b2ef-4e02-b725-ae5ea981608c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:31.613798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:31.614550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.614751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.615025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] PATH_INFO: `/v3/users/b483198b71eb454eb2f702eeff573ebe` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.616355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b483198b71eb454eb2f702eeff573ebe)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:31.618331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:31.716008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b483198b71eb454eb2f702eeff573ebe'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.729845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b483198b71eb454eb2f702eeff573ebe'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.731661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b483198b71eb454eb2f702eeff573ebe'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.757541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:31.775132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b483198b71eb454eb2f702eeff573ebe'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.788787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b483198b71eb454eb2f702eeff573ebe'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:31.805676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 972/1912] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:31 2022] DELETE /identity/v3/users/b483198b71eb454eb2f702eeff573ebe => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:31.810889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:31.811175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:31.811449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:31.850184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:31.851426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:31.962678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 941/1913] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:32.001069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:32.003857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:32.154924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836f73-4e3d-4d6d-ab55-4e33ab32d511 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:32.172911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:32.175547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:32.175547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:32.187836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:32.201045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:32.203605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:32.217433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 973/1914] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:32.257908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:32.260260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:32.286390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d0d23-96a5-4c05-b426-c5faafba1da8 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:32.304786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:32.305587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:32.305802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:32.306147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] PATH_INFO: `/v3/projects/473db8d46be04dab950c396001e0866c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:32.307375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473db8d46be04dab950c396001e0866c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:32.310920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:32.332712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:32.415764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473db8d46be04dab950c396001e0866c', 'request_id': 'req-5b71df72-90a6-4e76-b052-6b0b9b89dd92'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.429123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473db8d46be04dab950c396001e0866c', 'request_id': 'req-5b71df72-90a6-4e76-b052-6b0b9b89dd92'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.440707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473db8d46be04dab950c396001e0866c', 'request_id': 'req-5b71df72-90a6-4e76-b052-6b0b9b89dd92'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.468740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] The token cache is being invalidate because project 473db8d46be04dab950c396001e0866c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:32.470097 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.471061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.474247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 942/1915] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:32 2022] DELETE /identity/v3/projects/473db8d46be04dab950c396001e0866c => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:32.479365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:32.496259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f615c-af7f-4e86-ac27-7a21e067d5d0 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:32.618896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:32.619555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:32.619965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:32.620121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] PATH_INFO: `/v3/users/c821da64a5b644e4b4e5c73126e597fa` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:32.623664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c821da64a5b644e4b4e5c73126e597fa)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:32.632543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:32.700790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c821da64a5b644e4b4e5c73126e597fa'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.711387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c821da64a5b644e4b4e5c73126e597fa'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.712085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c821da64a5b644e4b4e5c73126e597fa'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.727065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c821da64a5b644e4b4e5c73126e597fa'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.735877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c821da64a5b644e4b4e5c73126e597fa'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:32.743665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 974/1916] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:32 2022] DELETE /identity/v3/users/c821da64a5b644e4b4e5c73126e597fa => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:33.120380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.122771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.139788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.141436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71df72-90a6-4e76-b052-6b0b9b89dd92 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:33.141561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.148053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:33.244557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:33.245419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.247257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.247554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] PATH_INFO: `/v3/projects/57ea106f0b414e2e9343f4f7fac880cb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.250748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] RBAC: Authorizing `identity:delete_project(project_id=57ea106f0b414e2e9343f4f7fac880cb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:33.253638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:33.296809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf1a75-138b-4d54-b362-57306cb94c8a admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:33.313220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:33.316651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.318124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.319168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] PATH_INFO: `/v3/projects/c3bbeb0749264ca9beafdd011df199d7` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.322263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3bbeb0749264ca9beafdd011df199d7)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:33.329848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57ea106f0b414e2e9343f4f7fac880cb', 'request_id': 'req-869f3771-26ed-402e-9e66-90dc6629f57a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.331733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:33.346080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57ea106f0b414e2e9343f4f7fac880cb', 'request_id': 'req-869f3771-26ed-402e-9e66-90dc6629f57a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.358408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57ea106f0b414e2e9343f4f7fac880cb', 'request_id': 'req-869f3771-26ed-402e-9e66-90dc6629f57a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.397254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] The token cache is being invalidate because project 57ea106f0b414e2e9343f4f7fac880cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:33.397554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.398312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-869f3771-26ed-402e-9e66-90dc6629f57a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.399885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 943/1917] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:33 2022] DELETE /identity/v3/projects/57ea106f0b414e2e9343f4f7fac880cb => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:33.404885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ed988-fefe-4180-af38-4b8d141e2c1b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.411446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ed988-fefe-4180-af38-4b8d141e2c1b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.411844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ed988-fefe-4180-af38-4b8d141e2c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.436157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dc2ed988-fefe-4180-af38-4b8d141e2c1b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:33.437649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dc2ed988-fefe-4180-af38-4b8d141e2c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.467052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3bbeb0749264ca9beafdd011df199d7', 'request_id': 'req-208c9add-0761-4617-8104-adf1208ce080'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.477559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3bbeb0749264ca9beafdd011df199d7', 'request_id': 'req-208c9add-0761-4617-8104-adf1208ce080'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.478551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:33.487818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3bbeb0749264ca9beafdd011df199d7', 'request_id': 'req-208c9add-0761-4617-8104-adf1208ce080'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.510623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] The token cache is being invalidate because project c3bbeb0749264ca9beafdd011df199d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:33.511956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.514517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.516590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 975/1918] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:33 2022] DELETE /identity/v3/projects/c3bbeb0749264ca9beafdd011df199d7 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:33.524029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.528345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.591713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 944/1919] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:33.601727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.601727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.601727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.640100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:33.642379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.652544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 945/1920] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:33.657472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.686337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c9add-0761-4617-8104-adf1208ce080 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:33.689591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe09f2-969e-4dd9-a136-963525502641 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:33.692704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:33.693686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.694395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.694906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] PATH_INFO: `/v3/users/42d49281a4b2484faf5124036aaba5e8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.696735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=42d49281a4b2484faf5124036aaba5e8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:33.702004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:33.722038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:33.722836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.723122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.723397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.724066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:33.724373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:33.734364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:33.763137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 946/1921] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:54:33.767580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.790090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d4a18-7d18-4e95-b8c2-778abf7e4279 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:33.795737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:33.797145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:33.799134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:33.799704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:33.800202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:33.801116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:33.803059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:33.820084 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42d49281a4b2484faf5124036aaba5e8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.839758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42d49281a4b2484faf5124036aaba5e8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.841395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42d49281a4b2484faf5124036aaba5e8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.860716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42d49281a4b2484faf5124036aaba5e8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.877919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42d49281a4b2484faf5124036aaba5e8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:33.878795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 947/1922] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:33 2022] POST /identity/v3/projects => generated 409 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:33.879901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.884684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:33.893233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 976/1923] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:33 2022] DELETE /identity/v3/users/42d49281a4b2484faf5124036aaba5e8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:33.893233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:33.896645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.013386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d265d-3ec3-4682-9aa2-34d7e02b0f1d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.051504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3523ad3-44d2-4eb4-94f4-bc03b903ee3e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.058026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.058701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.059637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.060057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.060752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.062844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.119528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 977/1924] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:33 2022] POST /identity/v3/users => generated 305 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:34.125279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.149991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095234e3-97be-4360-8c71-8b0956e4ca05 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.158074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.158250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.159105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.159395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.160178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.160612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] PATH_INFO: `/v3/users/21b321ee0a854831abeecbe59ebe7973` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.162023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b321ee0a854831abeecbe59ebe7973)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.163997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.164406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.164796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.165601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.167363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.182565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 978/1925] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:34.186879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.199469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2aff-cecf-4166-86b5-14707f7ab02c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.206035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.207177 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.207696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.208047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.208899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.211264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.232352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 979/1926] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:34.233618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.250004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:34.254607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3da65a-05c7-45c0-b3aa-d5bf4029ab3e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.267510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.268816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.269663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.270238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] PATH_INFO: `/v3/projects/42788046c7ea4da0bb426b9d7b91bb4b/users/d67f68c7927f49a8856289db10d65fac/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.277475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b321ee0a854831abeecbe59ebe7973'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.297930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b321ee0a854831abeecbe59ebe7973'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.307192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42788046c7ea4da0bb426b9d7b91bb4b, user_id=d67f68c7927f49a8856289db10d65fac, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.312482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd24d7-59a5-49d6-b9a8-0ce25de50852 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.320566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b321ee0a854831abeecbe59ebe7973'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.325795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b321ee0a854831abeecbe59ebe7973'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.342122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 980/1927] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:34 2022] PUT /identity/v3/projects/42788046c7ea4da0bb426b9d7b91bb4b/users/d67f68c7927f49a8856289db10d65fac/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:34.342446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-26beac6d-2d25-4099-8e51-00c8c1672e85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b321ee0a854831abeecbe59ebe7973'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.344207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.344671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.344942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.348093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 948/1928] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:33 2022] DELETE /identity/v3/users/21b321ee0a854831abeecbe59ebe7973 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:34.352655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.352655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.352849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.394556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] MFA Rules not processed for user `d67f68c7927f49a8856289db10d65fac`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:34.394778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:34.396026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.396518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.482381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:34.493787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 949/1929] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:34.499696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.502461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.534734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 981/1930] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:34.535481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d982a47-e181-4e59-b38c-8af64e8f4121 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.535628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.538472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.561178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.561892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.562180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.562456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] PATH_INFO: `/v3/projects/32bd19d0578d4da7ba59e77b4297716e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.568253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] RBAC: Authorizing `identity:delete_project(project_id=32bd19d0578d4da7ba59e77b4297716e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.573304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.655468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d1136-2e24-4a94-9e8f-6bb866107a26 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.678734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32bd19d0578d4da7ba59e77b4297716e', 'request_id': 'req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.709107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32bd19d0578d4da7ba59e77b4297716e', 'request_id': 'req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.724772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.725450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.725974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.726277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.729159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32bd19d0578d4da7ba59e77b4297716e', 'request_id': 'req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.741244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] The token cache is being invalidate because project 32bd19d0578d4da7ba59e77b4297716e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:34.741717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.742590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:34.744392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 950/1931] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:34 2022] DELETE /identity/v3/projects/32bd19d0578d4da7ba59e77b4297716e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:34.745228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.747310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.826925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:34.830343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.831984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6a2981-12c2-4c2f-ae94-111b7c92dbe2 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.847573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 982/1932] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:34.849180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3e31-f5e3-4dc4-9917-fea20051831c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.849903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3e31-f5e3-4dc4-9917-fea20051831c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.850705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf3e31-f5e3-4dc4-9917-fea20051831c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.864906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9065a-ba42-4fa7-9d5b-9a7b95ce28df admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:34.869900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:34.870544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.870829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.871107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.872343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:34.873922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-62cf3e31-f5e3-4dc4-9917-fea20051831c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:34.874834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:34.875126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-62cf3e31-f5e3-4dc4-9917-fea20051831c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:34.886720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 983/1933] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:34.901346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:34.904999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:34.907298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:34.937710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 951/1934] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/projects => generated 407 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:34.939446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:34.946116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:34.947753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.019012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:35.087086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 984/1935] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:35.091261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.099660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cc6b4-ef74-48d7-a2e0-784361a7bb48 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.103942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176a21f5-1351-4282-a27c-babe7a122204 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.108650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.109516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.109925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.110289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.111056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.112547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.113562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.114059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.114559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.115301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:35.115633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.115745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.117273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.134308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 985/1936] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:54:35.135284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.149005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f18578-dfbb-4b14-8be7-c95fe35b9a3e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.152564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 952/1937] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:34 2022] POST /identity/v3/users => generated 310 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:35.156390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.159805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.160667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.160992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.162686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.163453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.166609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.175360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb3cfb-9dae-4833-abc3-a667ace13c36 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.180616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.181285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.181898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.182011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.182774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.185368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.202218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 953/1938] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:35.203925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.219016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 986/1939] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:35 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:35.223587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.225978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0156db6-3b95-444d-bf3c-09ab6abff350 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.312446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.313445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.314023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.314305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] PATH_INFO: `/v3/projects/1af37e1dc86f41ff90703503aab9d2ec/users/d88715a92e5d46e3b56dca724458d434/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.331472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e7edb-89ef-4adf-88ac-4bb46ed5ea09 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.332004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af37e1dc86f41ff90703503aab9d2ec, user_id=d88715a92e5d46e3b56dca724458d434, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.334864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.336798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.337550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.337897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.338209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.338858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.340819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.348983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 954/1940] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:35 2022] PUT /identity/v3/projects/1af37e1dc86f41ff90703503aab9d2ec/users/d88715a92e5d46e3b56dca724458d434/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:35.353028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.373437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 987/1941] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:35 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:35.374590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.385229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018855a6-16cc-4268-9c4c-52737c86ffe6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.385749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:35.440551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712c142-1317-482d-a614-3ee65fa301b2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.445839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.446913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.446913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.447113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.447747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.449336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.468637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 955/1942] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:35.474054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.475772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.477728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.478391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.478676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.478951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.479717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.482757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.493137 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62264af5-beb6-44d2-a78c-7e61d58cf041 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.501611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.502497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.502842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.503300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] PATH_INFO: `/v3/projects/5114398f1cd44a37bf685610186f53b8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.505913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 988/1943] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:35.506087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5114398f1cd44a37bf685610186f53b8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.506186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.507224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.518846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff77b7-319d-4e15-9491-92714b588ea9 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.524817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.525724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.526132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.526485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] PATH_INFO: `/v3/projects/1af37e1dc86f41ff90703503aab9d2ec/users/d88715a92e5d46e3b56dca724458d434/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.529033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1af37e1dc86f41ff90703503aab9d2ec, user_id=d88715a92e5d46e3b56dca724458d434, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.536102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.550049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 989/1944] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:35 2022] PUT /identity/v3/projects/1af37e1dc86f41ff90703503aab9d2ec/users/d88715a92e5d46e3b56dca724458d434/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:35.552363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.582153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5114398f1cd44a37bf685610186f53b8', 'request_id': 'req-f393a308-68b0-4f41-9153-af7a762d99f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.588307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:35.593891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5114398f1cd44a37bf685610186f53b8', 'request_id': 'req-f393a308-68b0-4f41-9153-af7a762d99f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.625337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5114398f1cd44a37bf685610186f53b8', 'request_id': 'req-f393a308-68b0-4f41-9153-af7a762d99f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.630040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] The token cache is being invalidate because project 5114398f1cd44a37bf685610186f53b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:35.630419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.631153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f393a308-68b0-4f41-9153-af7a762d99f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.633109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 956/1945] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:35 2022] DELETE /identity/v3/projects/5114398f1cd44a37bf685610186f53b8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:35.634368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.634827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.635205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.639334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf633f-c5a8-4f4e-b497-19ca0f2599b6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.675197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] MFA Rules not processed for user `d88715a92e5d46e3b56dca724458d434`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:35.676580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.713255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.714320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.714749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.715373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.716162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.718129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.730230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 990/1946] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:35.731593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.734732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.747078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe392-787e-4810-a911-db0b4883bbd6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.752682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.757176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.757315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 957/1947] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:35.757399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.757399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] PATH_INFO: `/v3/users/d61b1728bcfb480296b587a3458d4d8c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.757528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.757528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.757843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d61b1728bcfb480296b587a3458d4d8c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.759997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.777759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38386268-ca20-4fcc-a937-addcf55d23c6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.782949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.783618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.783904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.784206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] PATH_INFO: `/v3/projects/0a8f14a3f7c944a7815e45744664ed52/users/c9c71c56fcc5407da37b342846f0d42a/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.800041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a8f14a3f7c944a7815e45744664ed52, user_id=c9c71c56fcc5407da37b342846f0d42a, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:35.803076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:35.809732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd61b1728bcfb480296b587a3458d4d8c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.816831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 958/1948] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:35 2022] PUT /identity/v3/projects/0a8f14a3f7c944a7815e45744664ed52/users/c9c71c56fcc5407da37b342846f0d42a/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:35.817576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd61b1728bcfb480296b587a3458d4d8c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.817715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.818541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd61b1728bcfb480296b587a3458d4d8c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.819197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.825915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:35.832464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd61b1728bcfb480296b587a3458d4d8c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.839469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b1693b97-5cb2-44cb-9ba1-88de7151dff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd61b1728bcfb480296b587a3458d4d8c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:35.845456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 991/1949] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:35 2022] DELETE /identity/v3/users/d61b1728bcfb480296b587a3458d4d8c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:35.846689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.846971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.847247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.878871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] MFA Rules not processed for user `c9c71c56fcc5407da37b342846f0d42a`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:35.880737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.882724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7df02c-bcb3-408d-bf92-b0429dd2fe21 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.914273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:35.938620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:35.939266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:35.939550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:35.940101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:35.942027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.967586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 992/1950] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:35.979462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:35.981007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:35.994863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaf457-3d67-4615-add0-bb808a6cd240 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:35.998815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.000121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.000469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.001143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.019910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.022411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.037218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 993/1951] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:36.041295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.043621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.057197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 959/1952] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:35 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:36.186248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:36.187685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:36.312098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef31a058-4bd5-4f5a-9826-4cf0d8b01e8b service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:36.319169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.320518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.321017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.321466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] PATH_INFO: `/v3/projects/e953f4bc2e704f4bb2597de829ad5385` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.322095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:36.323574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e953f4bc2e704f4bb2597de829ad5385)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.323853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:36.326342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.336949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f555d7-b4bf-46ed-a3c8-a30b3fb1ae3e service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:36.343256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.344014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.344363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.344711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.346717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:36.395485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e953f4bc2e704f4bb2597de829ad5385', 'request_id': 'req-148451a2-e25b-486b-9366-e72fbcd2acfc'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:36.422049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e953f4bc2e704f4bb2597de829ad5385', 'request_id': 'req-148451a2-e25b-486b-9366-e72fbcd2acfc'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:36.431158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e953f4bc2e704f4bb2597de829ad5385', 'request_id': 'req-148451a2-e25b-486b-9366-e72fbcd2acfc'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:36.446378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.447835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ecea7-49c0-493b-9a73-1da10e3ec0d1 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.451712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] The token cache is being invalidate because project e953f4bc2e704f4bb2597de829ad5385 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:36.452249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:36.453330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-148451a2-e25b-486b-9366-e72fbcd2acfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:36.458434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 994/1953] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:36 2022] DELETE /identity/v3/projects/e953f4bc2e704f4bb2597de829ad5385 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:36.461697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.461852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.462152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.465893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 960/1954] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:36 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:36.525245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:36.526717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:36.572004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:36.603914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 995/1955] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:36.611611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.611905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.612205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.634118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:36.655476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:36.657575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:36.671646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 961/1956] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:36.675023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:36.686489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e613-cdf7-4f3b-8721-4320e010faeb None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:36.691371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.691891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.692154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.692429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.693070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:36.693376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.694990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.708163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 996/1957] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:36.712488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:36.726165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690447a2-c0da-4194-9d5f-e10e6c161e2a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:36.733565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.734219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.734645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.734831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.735556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.737468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.780721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 962/1958] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:36 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:36.786372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:36.810204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0776d-2e35-4127-b8e7-84f343cc7c3f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:36.955915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:36.956686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:36.956947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:36.957218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:36.957915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:36.966404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:36.989856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 997/1959] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:36 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:36.993947 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.006204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5dd97-f5a1-4471-b025-a2c4d7f776e8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.011062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.011948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.012232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.012507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.013149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.015356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.027251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 963/1960] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:37.032034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.043891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b2db0f-fda6-41b0-9620-dbed4a799eae admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.049745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.050584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.050869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.051143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.051785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.053413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f702b3-d03b-4d25-afc3-e5607470f923 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.066075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 998/1961] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:37.069438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.079695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3a0fa-3587-4099-b616-eb711e1852e3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.084254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.084919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.085203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.085482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] PATH_INFO: `/v3/projects/680746814a354ff490355eeeccc38a5b/users/249b04b6ad26455d8a323237ceae7697/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.103352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680746814a354ff490355eeeccc38a5b, user_id=249b04b6ad26455d8a323237ceae7697, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.106253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.120251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 964/1962] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:37 2022] PUT /identity/v3/projects/680746814a354ff490355eeeccc38a5b/users/249b04b6ad26455d8a323237ceae7697/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:37.135619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.135619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.135619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.162236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] MFA Rules not processed for user `249b04b6ad26455d8a323237ceae7697`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:37.163626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:37.231446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 999/1963] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:37.236182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.306981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a4768-fe5b-428f-bc73-7bffd602eb87 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.311628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.312237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.312518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.312881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.313519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.315971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.351183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 965/1964] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:37.351288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.358826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171c1ec-2b93-48e8-8976-ce6dee233247 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.427453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:37.466605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.467234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.467518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.467797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.468438 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.470395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.500664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1000/1965] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:37.501851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.513703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf02938-ae9f-4d62-aee2-75d11f8ec6e2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.519068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.519838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.520174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.520466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.521692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.523052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.534232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 966/1966] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:37.538908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.549634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fafc3-6d6d-4730-907d-2c848d1a2eb4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.554418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.555027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.555305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.555573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.556354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.558021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d43cb2-b261-4cb5-8163-93581194c608 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.571925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1001/1967] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:37.577859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.589984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac96ca-1eaf-4af0-8472-73116c1d7bb6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.595156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.595915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.596199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.596576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] PATH_INFO: `/v3/projects/4d60d10491e444cdbc0e978da47f161e/users/7509cff442ad4c8c87fcf9100bcd0f65/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.617145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d60d10491e444cdbc0e978da47f161e, user_id=7509cff442ad4c8c87fcf9100bcd0f65, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.620157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.634288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 967/1968] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:37 2022] PUT /identity/v3/projects/4d60d10491e444cdbc0e978da47f161e/users/7509cff442ad4c8c87fcf9100bcd0f65/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:37.645106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.645655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.645848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.685257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] MFA Rules not processed for user `7509cff442ad4c8c87fcf9100bcd0f65`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:37.686622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:37.799756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1002/1969] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:37.804392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.876824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:37.898679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126ddc-ffe9-4e20-9d7c-5e8197bc1128 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:37.903965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:37.904588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:37.904868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:37.905146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:37.905783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:37.907924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:37.970480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:37.971282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 968/1970] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:37.983045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3eff13-160d-45a4-899f-8f73428a2888 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.110954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.112151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.112880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.113148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.114419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.116504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.197511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1003/1971] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:37 2022] POST /identity/v3/users => generated 299 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:38.203207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.222239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a635f-f837-417e-a0d3-9af546f96c95 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.233292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.234639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.235154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.235763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.236610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.238510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.257135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 969/1972] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:38.263441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.278511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75994a0d-19ca-4b5e-a1ae-9dc1d4074f3b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.299238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.300020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.300310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.300663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] PATH_INFO: `/v3/projects/1eff9979509c4d1a888f54e80d5cf342/users/df2e0917abf846de9f568cf0f201a708/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.322598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff9979509c4d1a888f54e80d5cf342, user_id=df2e0917abf846de9f568cf0f201a708, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.327585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.349557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1004/1973] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:38 2022] PUT /identity/v3/projects/1eff9979509c4d1a888f54e80d5cf342/users/df2e0917abf846de9f568cf0f201a708/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:38.353715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.370267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43479b9-b6d0-419e-aeb6-680903960eca admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.504992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.506801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.506801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.507184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.508230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.510297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0413a-51af-478b-a3d2-1734d6fa4491 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.525990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 970/1974] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:38.530048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.543267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53346fa9-6188-4912-b4be-7621e59cfbba admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.550735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.551413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.551699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.552022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] PATH_INFO: `/v3/projects/1eff9979509c4d1a888f54e80d5cf342/users/df2e0917abf846de9f568cf0f201a708/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.555730 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eff9979509c4d1a888f54e80d5cf342, user_id=df2e0917abf846de9f568cf0f201a708, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.557385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.565298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:38.581962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1005/1975] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:38 2022] PUT /identity/v3/projects/1eff9979509c4d1a888f54e80d5cf342/users/df2e0917abf846de9f568cf0f201a708/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:38.595577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.595679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.595871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.646829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] MFA Rules not processed for user `df2e0917abf846de9f568cf0f201a708`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:38.648358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:38.734016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.742594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:38.778829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 971/1976] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:38.792730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:38.794844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:38.829369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166ff9a-bf97-4a5e-9105-06005ffd6da4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.844639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.845514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.846019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.846480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] PATH_INFO: `/v3/users/c6d9081e96164166b1eacd0f37fd0760` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.849856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d9081e96164166b1eacd0f37fd0760)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.853099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.861364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:38.870571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5891c7d-a366-4b26-bfa1-22a6bba4857e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:38.875473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:38.876264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:38.876609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:38.876948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:38.940096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d9081e96164166b1eacd0f37fd0760'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:38.953669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d9081e96164166b1eacd0f37fd0760'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:38.954513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d9081e96164166b1eacd0f37fd0760'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:38.976193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:38.977775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a864d5c-e999-48b8-bf73-3399585da1d6 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:38.979920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d9081e96164166b1eacd0f37fd0760'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:38.990205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d9081e96164166b1eacd0f37fd0760'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:38.992841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 972/1977] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:38.998866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1006/1978] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:38 2022] DELETE /identity/v3/users/c6d9081e96164166b1eacd0f37fd0760 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:39.003681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:39.003966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:39.004377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:39.029477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:39.031310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:39.127051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 973/1979] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:39.141962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:39.143743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:39.236444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c9a97-a45d-4024-acaf-cba2b09a7c52 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:39.240936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:39.241775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:39.242092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:39.242367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:39.256192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:39.260256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:39.273916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1007/1980] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:39.704528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:39.704528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:39.725166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c7ab5-e373-42b5-b196-f31b368c1601 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:39.737672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:39.739884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:39.740489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:39.741269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] PATH_INFO: `/v3/projects/217f584268934c2eadc6f92e645c0dd8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:39.744430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=217f584268934c2eadc6f92e645c0dd8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:39.749003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:39.830274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217f584268934c2eadc6f92e645c0dd8', 'request_id': 'req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:39.841771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217f584268934c2eadc6f92e645c0dd8', 'request_id': 'req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:39.850628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217f584268934c2eadc6f92e645c0dd8', 'request_id': 'req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:39.867883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] The token cache is being invalidate because project 217f584268934c2eadc6f92e645c0dd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:39.868252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:39.869133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:39.875449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 974/1981] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:39 2022] DELETE /identity/v3/projects/217f584268934c2eadc6f92e645c0dd8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:39.876607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:39.898901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0584d879-f99f-48c1-adbc-d35352d9f7e4 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:39.925349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:39.981499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:39.982342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:39.982694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:39.983041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] PATH_INFO: `/v3/users/37e9f08930a149eb82c91c79513e6a02` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:39.984316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e9f08930a149eb82c91c79513e6a02)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:39.986655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:40.073256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e9f08930a149eb82c91c79513e6a02'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.092041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e9f08930a149eb82c91c79513e6a02'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.094331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e9f08930a149eb82c91c79513e6a02'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.125364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e9f08930a149eb82c91c79513e6a02'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.139752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e9f08930a149eb82c91c79513e6a02'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.160784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1008/1982] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:39 2022] DELETE /identity/v3/users/37e9f08930a149eb82c91c79513e6a02 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:40.660610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:40.663187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:40.694278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5df609-0232-45e5-b2cd-d2e6c6d05ce3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:40.737447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:40.795336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:40.796880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:40.797459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:40.798270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] PATH_INFO: `/v3/projects/40273961ee1a474eb8c9421e030ec235` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:40.802888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40273961ee1a474eb8c9421e030ec235)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:40.807136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:40.811953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:40.813541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:40.866851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40273961ee1a474eb8c9421e030ec235', 'request_id': 'req-092e15d8-1abe-40a5-b5a2-6269db0ce354'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.875751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40273961ee1a474eb8c9421e030ec235', 'request_id': 'req-092e15d8-1abe-40a5-b5a2-6269db0ce354'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.881681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780d601-76ea-41c1-90d8-ce22054d8fa9 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:40.890240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40273961ee1a474eb8c9421e030ec235', 'request_id': 'req-092e15d8-1abe-40a5-b5a2-6269db0ce354'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.906551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] The token cache is being invalidate because project 40273961ee1a474eb8c9421e030ec235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:40.907002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.907672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-092e15d8-1abe-40a5-b5a2-6269db0ce354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:40.909516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 975/1983] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:40 2022] DELETE /identity/v3/projects/40273961ee1a474eb8c9421e030ec235 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:40.915289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2594af-37a9-4895-9105-023534f8adfa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:40.915675 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2594af-37a9-4895-9105-023534f8adfa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:40.915861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2594af-37a9-4895-9105-023534f8adfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:40.943186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:40.943916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:40.944202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:40.944472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:40.945226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fe2594af-37a9-4895-9105-023534f8adfa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:40.946428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:40.946766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fe2594af-37a9-4895-9105-023534f8adfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:40.960526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:41.039001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.040471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.070094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 976/1984] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:41.071554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.071846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.072123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.074707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1009/1985] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:41.117317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:41.119849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:41.147525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 977/1986] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:41.148258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.164446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ac275-256e-4a21-af45-ea55f02c0967 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.175127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.175908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.176195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.176472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.177370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:41.177684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.179350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.208207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1010/1987] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:54:41.210936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.226674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c714ce9-6822-4111-a99a-67a9e4858ff7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.244869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.245693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.245781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.246083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.246783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.248804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.297641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 978/1988] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:41 2022] POST /identity/v3/projects => generated 369 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:41.301380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.316907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d37445-227e-4495-be8f-154a0193da22 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.513169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.513169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.513169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.513169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.513602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.518210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.590768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1011/1989] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:41 2022] POST /identity/v3/users => generated 285 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:41.594775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.616325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd563da-d854-49b6-8ba7-cfe0678ffd88 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.657174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.657798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.658828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.659215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.660114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.662508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.695715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.698057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 979/1990] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:41.718668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454e49a-dfb8-4afb-8199-f2b1d8c94763 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.733193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.733971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.734959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.738549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.740213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.744881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbcf28-4c15-4b34-b118-be1898a6e172 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.779905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1012/1991] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:41.783606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:41.801157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276d8a-3a88-4c91-90a3-d37d7504bef5 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:41.808522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:41.811768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.813316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.814537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] PATH_INFO: `/v3/projects/b8d6a8c7668f4a77a57f270c61104b40/users/c1f1ed0d4ee54bcf96b709eef3753182/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.852724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d6a8c7668f4a77a57f270c61104b40, user_id=c1f1ed0d4ee54bcf96b709eef3753182, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:41.857848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:41.861807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:41.887945 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 980/1992] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:41 2022] PUT /identity/v3/projects/b8d6a8c7668f4a77a57f270c61104b40/users/c1f1ed0d4ee54bcf96b709eef3753182/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:41.899979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:41.900869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:41.901466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:41.966890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] MFA Rules not processed for user `c1f1ed0d4ee54bcf96b709eef3753182`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:41.968572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.068625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1013/1993] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:42.073143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.099638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.101376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.117591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:42.161144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd77cda-666a-4f5e-9cd9-a1acfd782289 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.166590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.167284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.168230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.168230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.168821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.170968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.190536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957abf09-f9d6-4f2d-9d2d-30d3e767b528 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.195823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.197213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.197575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.197967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.200793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.207374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 981/1994] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:42 2022] POST /identity/v3/projects => generated 367 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:42.208405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.293812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb2b726-fe99-4402-854d-7badd59842cb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.309711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.309711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.309900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.309900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.309900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.309900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.310207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.310207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.310331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1014/1995] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:42.332114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 982/1996] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:42 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:42.336145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.350980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d41def-6c79-45de-9533-36e408305551 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.356605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.357620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.357940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.358406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.359057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.361125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.374406 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1015/1997] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:42.378790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.393712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a7a28-cc1a-48e0-9b38-c07f5d4a20ce admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.399081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.400063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.400566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.400940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] PATH_INFO: `/v3/projects/8b06a31004174237962ace15cfa17063/users/76345e5752a7472d9f4e305619266dbb/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.424400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b06a31004174237962ace15cfa17063, user_id=76345e5752a7472d9f4e305619266dbb, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.427647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.444743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 983/1998] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:42 2022] PUT /identity/v3/projects/8b06a31004174237962ace15cfa17063/users/76345e5752a7472d9f4e305619266dbb/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:42.448750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.474738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f457b0-fda5-4b95-b5f1-89a5e1ccafcf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.547751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.548723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.549121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.549688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.550458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.552106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a630547-f159-4040-a136-9e600bd66d90 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.563450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1016/1999] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:42.567627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.580615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3bbc2d-a8f0-4222-a68d-07c3f555bbf1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.587267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.588004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.588446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.588827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] PATH_INFO: `/v3/projects/8b06a31004174237962ace15cfa17063/users/76345e5752a7472d9f4e305619266dbb/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.591186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b06a31004174237962ace15cfa17063, user_id=76345e5752a7472d9f4e305619266dbb, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.594149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.606054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 984/2000] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:42 2022] PUT /identity/v3/projects/8b06a31004174237962ace15cfa17063/users/76345e5752a7472d9f4e305619266dbb/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:42.616315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.616617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.616903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.653819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] MFA Rules not processed for user `76345e5752a7472d9f4e305619266dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:42.655111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.704636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.707301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.713344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:42.759056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:42.765369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1017/2001] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:42.776336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:42.779140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:42.812857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24308ac-2b19-4d28-a457-e3026bdd0019 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.817692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.818532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.818798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.819071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] PATH_INFO: `/v3/users/c9c71c56fcc5407da37b342846f0d42a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.821021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9c71c56fcc5407da37b342846f0d42a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.823142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.845497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc604840-3801-49cc-b64c-3a109f094873 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:42.849798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:42.852041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.852391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.852715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.868017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:42.869556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9489813-7a92-46b0-87e0-9f1f832a9f4a service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:42.881479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1018/2002] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:42 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:42.882790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9c71c56fcc5407da37b342846f0d42a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:42.892104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9c71c56fcc5407da37b342846f0d42a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:42.909682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9c71c56fcc5407da37b342846f0d42a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:42.910639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9c71c56fcc5407da37b342846f0d42a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:42.919044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9c71c56fcc5407da37b342846f0d42a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:42.925354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 985/2003] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:42 2022] DELETE /identity/v3/users/c9c71c56fcc5407da37b342846f0d42a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:42.930108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:42.930571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:42.930648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:42.960656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:42.968485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:43.062751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1019/2004] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:43.085069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:43.086565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:43.233886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66f250-59fa-4eb4-a607-5a4e93facd89 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:43.243548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:43.244153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:43.244452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:43.245135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:43.274001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:43.275110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:43.276841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:43.278610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf668ee-cc78-4e3b-a817-14a66256238e service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:43.290646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 986/2005] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:43.326441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4f48-7971-4393-a134-0d138b6fd7b3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:43.352992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:43.353650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:43.353978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:43.354230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] PATH_INFO: `/v3/users/d67f68c7927f49a8856289db10d65fac` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:43.355423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d67f68c7927f49a8856289db10d65fac)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:43.357344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:43.482037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd67f68c7927f49a8856289db10d65fac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:43.505453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd67f68c7927f49a8856289db10d65fac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:43.507137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd67f68c7927f49a8856289db10d65fac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:43.540596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:43.550733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd67f68c7927f49a8856289db10d65fac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:43.584383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd67f68c7927f49a8856289db10d65fac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:43.606863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1020/2006] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:43 2022] DELETE /identity/v3/users/d67f68c7927f49a8856289db10d65fac => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:43.612365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:43.612649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:43.612926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:43.669210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:43.670482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:43.791063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:43.830389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 987/2007] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:43.841703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:43.844132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:43.940139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0a286-9905-4870-ac8d-31a560433564 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:43.945169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:43.946202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:43.946592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:43.947009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:43.963068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:43.966603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9200dd72-83ef-4fdb-a990-bb27449ccdc4 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:43.979587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1021/2008] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:44.132817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.134385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:44.157420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd7b5ae-102d-490e-95dc-56069e9e9960 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:44.168839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:44.169510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.169796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.189777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] PATH_INFO: `/v3/projects/0a8f14a3f7c944a7815e45744664ed52` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.193429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a8f14a3f7c944a7815e45744664ed52)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:44.199082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:44.315416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a8f14a3f7c944a7815e45744664ed52', 'request_id': 'req-0b40d482-905c-4134-8e7c-6d556af2cb45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.337692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a8f14a3f7c944a7815e45744664ed52', 'request_id': 'req-0b40d482-905c-4134-8e7c-6d556af2cb45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.349454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a8f14a3f7c944a7815e45744664ed52', 'request_id': 'req-0b40d482-905c-4134-8e7c-6d556af2cb45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.420737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] The token cache is being invalidate because project 0a8f14a3f7c944a7815e45744664ed52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:44.423423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.425179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0b40d482-905c-4134-8e7c-6d556af2cb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.432631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 988/2009] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:44 2022] DELETE /identity/v3/projects/0a8f14a3f7c944a7815e45744664ed52 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:44.439507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.440356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.440356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.479803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:44.482656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:44.623373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1022/2010] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:44.630978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.631267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.631562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.662714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.672705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:44.677575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:44.678880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:44.701395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aed4d-077b-43fb-94b1-92af5a3d8bd3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:44.721580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 989/2011] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:44.725475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:44.726974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.728707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.728993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.729334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] PATH_INFO: `/v3/projects/42788046c7ea4da0bb426b9d7b91bb4b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.736238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42788046c7ea4da0bb426b9d7b91bb4b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:44.739989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:44.747249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdcf62-0f5d-4104-89b7-506e645d253d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:44.760449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:44.761069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.762117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.762421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.763070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:44.763380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:44.766086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:44.796054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 990/2012] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:44.807748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.833144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e48ea4-3de7-4456-8a5f-477663a751a7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:44.841606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:44.842642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:44.843425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:44.843890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:44.845727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:44.849383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:44.880951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42788046c7ea4da0bb426b9d7b91bb4b', 'request_id': 'req-94d59d73-3128-4b14-b8d4-da109bbe0513'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.895835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42788046c7ea4da0bb426b9d7b91bb4b', 'request_id': 'req-94d59d73-3128-4b14-b8d4-da109bbe0513'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.901555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 991/2013] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:44 2022] POST /identity/v3/projects => generated 361 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:44.905797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.910562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42788046c7ea4da0bb426b9d7b91bb4b', 'request_id': 'req-94d59d73-3128-4b14-b8d4-da109bbe0513'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.934287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] The token cache is being invalidate because project 42788046c7ea4da0bb426b9d7b91bb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:44.936806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.938941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:44.944806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1023/2014] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:44 2022] DELETE /identity/v3/projects/42788046c7ea4da0bb426b9d7b91bb4b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:44.948694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:44.951597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:44.983636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:45.051990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034ed76-7445-4e3d-9acf-69e11f16471f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.065702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.067267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.069553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.070022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.071619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.075022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.130753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 992/2015] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:44 2022] POST /identity/v3/users => generated 281 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:45.144331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.146188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.162998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2baabbf-2f90-422e-aa59-8acefd691dfb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.166031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d59d73-3128-4b14-b8d4-da109bbe0513 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.169832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.171537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.172213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.172730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.173941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.175921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.178004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.178687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.180996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.181599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] PATH_INFO: `/v3/users/d88715a92e5d46e3b56dca724458d434` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.190161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d88715a92e5d46e3b56dca724458d434)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.196045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.198295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 993/2016] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:45.199680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.219328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef08c17-8b5f-4f78-bb57-f9ad560bf087 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.235388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.236174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.236723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.237094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.237844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.239572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.283389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 994/2017] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:45.284585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.293608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:45.307949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8b176d-2a3d-412f-a6eb-962501614f25 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.316419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.317771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.318318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.318733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] PATH_INFO: `/v3/projects/c948c1ff6a3b4e11b0a844f416e8fb32/users/e15e8627c0d7464eaf71955b5dc48a76/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.348826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd88715a92e5d46e3b56dca724458d434'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.365656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd88715a92e5d46e3b56dca724458d434'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.366621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd88715a92e5d46e3b56dca724458d434'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.377299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c948c1ff6a3b4e11b0a844f416e8fb32, user_id=e15e8627c0d7464eaf71955b5dc48a76, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.381236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe8570f-7804-4e6a-94bc-b8c0341cb24d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.395916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd88715a92e5d46e3b56dca724458d434'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.408923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 995/2018] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:45 2022] PUT /identity/v3/projects/c948c1ff6a3b4e11b0a844f416e8fb32/users/e15e8627c0d7464eaf71955b5dc48a76/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:45.415715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.416009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.416290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.420252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd88715a92e5d46e3b56dca724458d434'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.433925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1024/2019] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:44 2022] DELETE /identity/v3/users/d88715a92e5d46e3b56dca724458d434 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:45.474573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] MFA Rules not processed for user `e15e8627c0d7464eaf71955b5dc48a76`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:45.475841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.527012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.530453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.609177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 996/2020] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:45.647763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.648942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cb9de-638d-476b-85b4-d2d643f1c062 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.649670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.660433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.661015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.661294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.661567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] PATH_INFO: `/v3/users/c1f1ed0d4ee54bcf96b709eef3753182` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.662857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f1ed0d4ee54bcf96b709eef3753182)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.665510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.734122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:45.767587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f1ed0d4ee54bcf96b709eef3753182'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.771353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c30e48-1ca8-44bf-aeb9-81c1b4eb874f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.781487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f1ed0d4ee54bcf96b709eef3753182'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.782109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f1ed0d4ee54bcf96b709eef3753182'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.793208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:45.793905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.794178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.794449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.800709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f1ed0d4ee54bcf96b709eef3753182'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.806134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.820600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c8ff5a45-5f96-4456-ab87-2571dfe8a324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f1ed0d4ee54bcf96b709eef3753182'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:45.829614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1025/2021] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:45 2022] DELETE /identity/v3/users/c1f1ed0d4ee54bcf96b709eef3753182 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:45.834140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:45.834647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:45.835194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:45.840485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:45.843534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:45.863300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:45.864243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 997/2022] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:45.864862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.891661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.893583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:45.912009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615e3a-c2c0-4dcf-9a5d-0d3d09c7955f service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:45.959670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1026/2023] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:45.974751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:45.976613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.015534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.016508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.016776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.017126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] PATH_INFO: `/v3/users/e15e8627c0d7464eaf71955b5dc48a76` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.018440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e15e8627c0d7464eaf71955b5dc48a76)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.020598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.043653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:46.057708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778501-a1eb-43f7-a567-1715f2ff0fb1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.062587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.062807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.063088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.063371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.073206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.075281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.081772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e15e8627c0d7464eaf71955b5dc48a76'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.084868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1027/2024] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:46.085741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.087297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.090837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e15e8627c0d7464eaf71955b5dc48a76'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.100787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d90d4-1f9d-4b81-b27a-7612e30fe756 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.105996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.106428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e15e8627c0d7464eaf71955b5dc48a76'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.106628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.106913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.107121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e15e8627c0d7464eaf71955b5dc48a76'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.107236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] PATH_INFO: `/v3/projects/1af37e1dc86f41ff90703503aab9d2ec` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.108367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1af37e1dc86f41ff90703503aab9d2ec)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.110365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.115007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c7b4a4a3-3f14-41af-96fc-62e4afacd648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e15e8627c0d7464eaf71955b5dc48a76'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.124690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 998/2025] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:45 2022] DELETE /identity/v3/users/e15e8627c0d7464eaf71955b5dc48a76 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:46.126537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.127055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.127435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.149089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:46.150528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.170909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:46.175886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1af37e1dc86f41ff90703503aab9d2ec', 'request_id': 'req-1c295940-9dfe-41b5-b101-0fbbd7db7f74'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.186825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1af37e1dc86f41ff90703503aab9d2ec', 'request_id': 'req-1c295940-9dfe-41b5-b101-0fbbd7db7f74'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.197393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1af37e1dc86f41ff90703503aab9d2ec', 'request_id': 'req-1c295940-9dfe-41b5-b101-0fbbd7db7f74'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.217782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] The token cache is being invalidate because project 1af37e1dc86f41ff90703503aab9d2ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:46.218108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.219385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1c295940-9dfe-41b5-b101-0fbbd7db7f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.222338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1028/2026] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:46 2022] DELETE /identity/v3/projects/1af37e1dc86f41ff90703503aab9d2ec => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:46.227713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49971-1e72-4312-a4e4-8708b1f41302 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.228047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49971-1e72-4312-a4e4-8708b1f41302 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.228279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c49971-1e72-4312-a4e4-8708b1f41302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.235323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 999/2027] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:46.245391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.247407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.272048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c3c49971-1e72-4312-a4e4-8708b1f41302 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:46.272048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c3c49971-1e72-4312-a4e4-8708b1f41302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.354514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1029/2028] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:46.363243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.363243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.363243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.367605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd7f1a3-e84e-42df-84c5-1f6e1528b477 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.395736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:46.398009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.411528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1030/2029] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:46.417333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.427226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:46.436371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6aa551-32a0-42c7-8d6d-15e0fe0e5bb4 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.438297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.439194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.439487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.440381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.445457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.449337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.449630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.449940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.451348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:46.451672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.453077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.453315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.454852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.468966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1000/2030] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:46.470038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1031/2031] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:46.473665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.490652 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65725b89-467f-4343-8832-73a134aed9a5 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.498307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.500131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.500465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.501051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.501938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.503825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.544378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1001/2032] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:46.548951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.560224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe3012-2eb3-4341-85e1-b45cb8fdc19d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.638547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.639292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.639680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.640041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.640741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.653093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.683921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.685746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.710743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1032/2033] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:46.717857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.729528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58d04da-14a5-49a5-b1e5-b99dbeda6846 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.736234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.736893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.737179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.737458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] PATH_INFO: `/v3/projects/b8d6a8c7668f4a77a57f270c61104b40` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.738248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b2828-4324-4b54-870f-f823cc2b58e7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.738637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d6a8c7668f4a77a57f270c61104b40)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.740586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.743559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.744301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.744585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.745021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.745671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.747819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.760233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1033/2034] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:46.765036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.776781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02606bf4-0695-43a7-b819-b34bcf01232f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.782873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.783585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.783867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.784145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.784798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.787448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.799275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d6a8c7668f4a77a57f270c61104b40', 'request_id': 'req-13d36d37-9f5d-49ca-96fe-b8444b12081c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.801199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1034/2035] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:46.802019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.810603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d6a8c7668f4a77a57f270c61104b40', 'request_id': 'req-13d36d37-9f5d-49ca-96fe-b8444b12081c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.815409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a43ade-cabd-4e00-952b-593f18b01465 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.817667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d6a8c7668f4a77a57f270c61104b40', 'request_id': 'req-13d36d37-9f5d-49ca-96fe-b8444b12081c'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.834561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] The token cache is being invalidate because project b8d6a8c7668f4a77a57f270c61104b40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:46.834880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.835820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:46.837461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:46.837841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1002/2036] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:46 2022] DELETE /identity/v3/projects/b8d6a8c7668f4a77a57f270c61104b40 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:46.843449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:46.846895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:46.905249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:46.905951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.906860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.906860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] PATH_INFO: `/v3/projects/24d494c60b514236a39f31ea4be6d2da/users/af768a9224e3408ab757ce228828e41a/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:46.929194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d494c60b514236a39f31ea4be6d2da, user_id=af768a9224e3408ab757ce228828e41a, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:46.931940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0903cf30-cf0b-4dec-83da-c676540f5f0a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:46.948890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1035/2037] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:46 2022] PUT /identity/v3/projects/24d494c60b514236a39f31ea4be6d2da/users/af768a9224e3408ab757ce228828e41a/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:46.959318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d36d37-9f5d-49ca-96fe-b8444b12081c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:46.960520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:46.961048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:46.961144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.019931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] MFA Rules not processed for user `af768a9224e3408ab757ce228828e41a`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:47.021759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.029672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.050938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.051643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.052076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.052353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] PATH_INFO: `/v3/users/76345e5752a7472d9f4e305619266dbb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.053703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] RBAC: Authorizing `identity:delete_user(user_id=76345e5752a7472d9f4e305619266dbb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.055974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.119609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76345e5752a7472d9f4e305619266dbb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.126878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1036/2038] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:47.126878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.126878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.133746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76345e5752a7472d9f4e305619266dbb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.146699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3952b4-8fc5-4855-bdd8-8bd77e7e0446 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.150768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76345e5752a7472d9f4e305619266dbb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.151655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76345e5752a7472d9f4e305619266dbb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.152704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.153502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.153851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.154378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] PATH_INFO: `/v3/projects/c948c1ff6a3b4e11b0a844f416e8fb32` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.155701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c948c1ff6a3b4e11b0a844f416e8fb32)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.157771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.162294 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76345e5752a7472d9f4e305619266dbb'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.171449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1003/2039] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:46 2022] DELETE /identity/v3/users/76345e5752a7472d9f4e305619266dbb => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:47.172617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.174110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.222992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c948c1ff6a3b4e11b0a844f416e8fb32', 'request_id': 'req-0d1fa775-45ff-44be-a865-510c1e458663'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.235467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c948c1ff6a3b4e11b0a844f416e8fb32', 'request_id': 'req-0d1fa775-45ff-44be-a865-510c1e458663'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.252063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c948c1ff6a3b4e11b0a844f416e8fb32', 'request_id': 'req-0d1fa775-45ff-44be-a865-510c1e458663'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.265363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] The token cache is being invalidate because project c948c1ff6a3b4e11b0a844f416e8fb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:47.265687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.266491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.271579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1037/2040] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:47 2022] DELETE /identity/v3/projects/c948c1ff6a3b4e11b0a844f416e8fb32 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:47.273033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.278283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.290499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd7d40-f21d-46bf-8a7c-36538e12ffac admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.347612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.414311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fa775-45ff-44be-a865-510c1e458663 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.416134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.418462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.418756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.419053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] PATH_INFO: `/v3/users/249b04b6ad26455d8a323237ceae7697` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.421012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] RBAC: Authorizing `identity:delete_user(user_id=249b04b6ad26455d8a323237ceae7697)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.423044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.426518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.427137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.427417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.427690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.428514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.431573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf381d-e422-4d68-b50c-a3956d386581 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.455255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.470368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1038/2041] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/projects => generated 379 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:47.472894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443e35-f3d8-4b20-8762-47accca56bf9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.473302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443e35-f3d8-4b20-8762-47accca56bf9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.474027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8443e35-f3d8-4b20-8762-47accca56bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.492077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '249b04b6ad26455d8a323237ceae7697'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.503398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f8443e35-f3d8-4b20-8762-47accca56bf9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:47.503688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '249b04b6ad26455d8a323237ceae7697'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.504636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8443e35-f3d8-4b20-8762-47accca56bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.521367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '249b04b6ad26455d8a323237ceae7697'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.522192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '249b04b6ad26455d8a323237ceae7697'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.532130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '249b04b6ad26455d8a323237ceae7697'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.539465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1004/2042] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:47 2022] DELETE /identity/v3/users/249b04b6ad26455d8a323237ceae7697 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:47.540060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.541580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.628008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1039/2043] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:47.629218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.629613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.630349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.635127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe4b9b-cd62-46b0-b4fd-bee73998a59f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.641439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.642090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.642402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.642703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.643342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.645259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aae902-852e-4715-83a1-e62cb2463700 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.653229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:47.654404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.665612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1040/2044] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:47.665612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.665612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.678812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce12cea-5151-46ff-9909-3c7fa56e1bc2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.681972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1005/2045] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:47.683777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.684464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.685066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.686990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.687651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.688145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.688332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] PATH_INFO: `/v3/projects/8b06a31004174237962ace15cfa17063` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.689411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b06a31004174237962ace15cfa17063)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.691472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.710430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:47.711745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.721040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1006/2046] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:47.721843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.723185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.752545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b06a31004174237962ace15cfa17063', 'request_id': 'req-36bff431-fbe7-48e4-8142-2f654dea0d9c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.767182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b06a31004174237962ace15cfa17063', 'request_id': 'req-36bff431-fbe7-48e4-8142-2f654dea0d9c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.773314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b06a31004174237962ace15cfa17063', 'request_id': 'req-36bff431-fbe7-48e4-8142-2f654dea0d9c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.786279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] The token cache is being invalidate because project 8b06a31004174237962ace15cfa17063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:47.786646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.787376 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:47.788940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1041/2047] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:47 2022] DELETE /identity/v3/projects/8b06a31004174237962ace15cfa17063 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:47.789767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.791127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.795951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763313e1-c735-47d3-a7d9-708897b5bcfe None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.820369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.846553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.860034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.860925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.861218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.861495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.863462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.877141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.878365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bff431-fbe7-48e4-8142-2f654dea0d9c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.878665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.884474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.885264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.885596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.886052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.887521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.889683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc672a-46bb-4b4f-a538-0a1c2fa6e3cb admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.889802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1007/2048] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:47.890455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.892494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.905844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f6059-807b-4458-b012-a9a6985e42f1 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.909448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1042/2049] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:47 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:47.910763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.911063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.911326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.912554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.913494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.915536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.916295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.917389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:47.917969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.919935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.933531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1008/2050] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:47.934615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.938251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:47.939623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:47.944651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d92c8a-c285-4be4-84bf-d037171fb39b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.950941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1043/2051] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:47.951825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:47.957315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.958141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.959051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.959351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] PATH_INFO: `/v3/projects/34534931e9ed4e8f94220b6b9acce4c1/users/e066102e33994eae8eb7bc3bd8395703/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.962454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed5d8d-6f4c-4a91-93c4-23119d3c63d1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:47.976058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:47.976788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:47.977078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:47.977707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:47.978408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.980705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:47.983140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34534931e9ed4e8f94220b6b9acce4c1, user_id=e066102e33994eae8eb7bc3bd8395703, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:47.986151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974dd262-963f-4b04-9e79-fbb54b5b5f2c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.004693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1009/2052] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:47 2022] PUT /identity/v3/projects/34534931e9ed4e8f94220b6b9acce4c1/users/e066102e33994eae8eb7bc3bd8395703/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:48.006083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05371e38-cce0-4895-819f-944de54113cf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.006550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05371e38-cce0-4895-819f-944de54113cf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.006840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05371e38-cce0-4895-819f-944de54113cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.018047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1044/2053] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:47 2022] POST /identity/v3/projects => generated 363 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:48.018972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.029785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-05371e38-cce0-4895-819f-944de54113cf None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:48.031046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05371e38-cce0-4895-819f-944de54113cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.100254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c8be1-d1aa-411a-90a0-d248df0eb454 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.107068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1010/2054] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:48.107068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05371e38-cce0-4895-819f-944de54113cf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.107713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.107713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.107713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.108132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.108544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.110253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.117332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05371e38-cce0-4895-819f-944de54113cf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.122137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1045/2055] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:48.122988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.127508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.128130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.128459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.128778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.129472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.131467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.133407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa9a82-e986-4e23-adf8-2070d64c8978 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.144926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.145549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.145831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.146788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.147587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:48.147861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.149611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.162926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1011/2056] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/users => generated 282 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:48.163398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.164599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1046/2057] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:48.165328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.174971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756681-941a-4da2-8281-336654c264d4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.175328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a44423-0077-4c89-bcff-63d3f35f12d7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.180042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.180180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.180656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.180780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.180988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.181089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.181236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.181329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] PATH_INFO: `/v3/projects/34534931e9ed4e8f94220b6b9acce4c1/users/e066102e33994eae8eb7bc3bd8395703/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.181843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.183836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34534931e9ed4e8f94220b6b9acce4c1, user_id=e066102e33994eae8eb7bc3bd8395703, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.184040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.186666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.195315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1047/2058] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:48.197116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.198430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1012/2059] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:48 2022] PUT /identity/v3/projects/34534931e9ed4e8f94220b6b9acce4c1/users/e066102e33994eae8eb7bc3bd8395703/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:48.199869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.209850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e06074-ddb2-40fa-b7bd-5541044a4aa4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.281716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.282409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.282698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.282970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.283628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.285256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b0f74f-efe9-40bc-ac96-0770b97424c3 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.285676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.290910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.291097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:48.291623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.291931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.292361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.293477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.295143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61bbaf1-b840-4582-8a36-1a8020daaa5c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.309363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1013/2060] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:48.310514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.310806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.311093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.321080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1048/2061] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:48.321847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.323525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.338476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:48.341575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] MFA Rules not processed for user `e066102e33994eae8eb7bc3bd8395703`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:48.342873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.392922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999911a4-54bc-468d-ae2d-6e6c307f03a8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.397736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.398433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.398744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.399024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] PATH_INFO: `/v3/projects/680746814a354ff490355eeeccc38a5b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.400153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680746814a354ff490355eeeccc38a5b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.402266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.426725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1014/2062] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:48.427470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.439998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e74d91-0802-4ed5-9da1-04f376452d34 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.445338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.446114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.446395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.446669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] PATH_INFO: `/v3/projects/67727678d86647b6a2162506b972510f/users/41c76612734f419c9000da2e3b9774b8/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.458509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680746814a354ff490355eeeccc38a5b', 'request_id': 'req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.464901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] RBAC: Authorizing `identity:create_grant(project_id=67727678d86647b6a2162506b972510f, user_id=41c76612734f419c9000da2e3b9774b8, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.467089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680746814a354ff490355eeeccc38a5b', 'request_id': 'req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.473172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680746814a354ff490355eeeccc38a5b', 'request_id': 'req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.473920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.488024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] The token cache is being invalidate because project 680746814a354ff490355eeeccc38a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:48.488316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.489343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.489998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1015/2063] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:48 2022] PUT /identity/v3/projects/67727678d86647b6a2162506b972510f/users/41c76612734f419c9000da2e3b9774b8/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:48.491342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.493490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.493935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1049/2064] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:48 2022] DELETE /identity/v3/projects/680746814a354ff490355eeeccc38a5b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:48.496052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.498421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.577269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa5dec-9f4c-4d20-b1ee-c8f796599427 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.578008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319de06-69cb-434f-9146-0a7bce44495b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.583686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.584298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.584580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.584985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.585632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.587633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.609642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:48.611788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1016/2065] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:48.612676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.614317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.626614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b722f4-944c-4466-9ccb-0e23b2407130 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.631522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.632144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.632422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.632695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] PATH_INFO: `/v3/users/7509cff442ad4c8c87fcf9100bcd0f65` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.633022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.633630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.633810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7509cff442ad4c8c87fcf9100bcd0f65)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.634058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.634337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.635763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.636091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.685733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7509cff442ad4c8c87fcf9100bcd0f65'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.693449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7509cff442ad4c8c87fcf9100bcd0f65'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.698313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:48.705074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.706556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a678a722-6368-4c77-9a4a-2bd0f6ae929d service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.708525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7509cff442ad4c8c87fcf9100bcd0f65'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.709321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7509cff442ad4c8c87fcf9100bcd0f65'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.717386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1050/2066] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:48.717700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7509cff442ad4c8c87fcf9100bcd0f65'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:48.718643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.718933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.719344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.724854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1017/2067] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:48 2022] DELETE /identity/v3/users/7509cff442ad4c8c87fcf9100bcd0f65 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:48.725541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.727182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.753284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] MFA Rules not processed for user `41c76612734f419c9000da2e3b9774b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:48.754660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.819584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6976-abe5-4f7e-ab75-4340412c3360 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.825938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.826779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.827094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.827484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.828256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.830006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.838257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1051/2068] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:48.841527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1018/2069] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:48.854953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.857825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.860048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.867152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d538-6976-4c07-8313-5e875fb655e9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.874382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.875319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.875989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.876266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.876922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.878715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.897023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1052/2070] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:48.897023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.897877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:48.947211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d3cbf-47d1-4cc6-b7b7-d4cef7e031b8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.951691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.952304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.952586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.952861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:48.966468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:48.969670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:48.982441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1019/2071] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:48.983356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:48.983920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeffa1f-6090-4093-adcb-49f72757d772 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.994427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809db04e-b76b-443c-b593-d60956d70721 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:48.995569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:48.996745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:48.997032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:48.997349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.001276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.004542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.006440 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.008327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.008667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] PATH_INFO: `/v3/projects/705702811e084c4595ea23dbb56f0064/users/b7d64e5cd4824d2d8506b56e9b6d8688/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.017886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:49.035886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] RBAC: Authorizing `identity:create_grant(project_id=705702811e084c4595ea23dbb56f0064, user_id=b7d64e5cd4824d2d8506b56e9b6d8688, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.038862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.070369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1020/2072] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:48 2022] PUT /identity/v3/projects/705702811e084c4595ea23dbb56f0064/users/b7d64e5cd4824d2d8506b56e9b6d8688/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:49.074674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.081599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.100223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.102719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1aac9d-a3eb-4e7c-8266-9cc2268dd0ed service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.114726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1053/2073] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:49.116201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.116497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.116785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.154843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] MFA Rules not processed for user `b7d64e5cd4824d2d8506b56e9b6d8688`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:49.156276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.208018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:49.231487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf5e8c-6cd2-4259-a732-7afde032341c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.246524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.247188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.247472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.247753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] PATH_INFO: `/v3/projects/4d60d10491e444cdbc0e978da47f161e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.249495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d60d10491e444cdbc0e978da47f161e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.251473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.296398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1054/2074] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:49.297634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.311925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247a87c6-0697-47c4-b829-7587d3e96bd1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.322543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.323667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.324859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.325304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.326546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.329430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.338964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d60d10491e444cdbc0e978da47f161e', 'request_id': 'req-82167ff0-07cd-4c2d-95c7-02a575fe2388'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.359769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d60d10491e444cdbc0e978da47f161e', 'request_id': 'req-82167ff0-07cd-4c2d-95c7-02a575fe2388'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.370508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d60d10491e444cdbc0e978da47f161e', 'request_id': 'req-82167ff0-07cd-4c2d-95c7-02a575fe2388'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.378174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1055/2075] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:49 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:49.382142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.406175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] The token cache is being invalidate because project 4d60d10491e444cdbc0e978da47f161e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:49.406557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.407455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.409404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1021/2076] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:49 2022] DELETE /identity/v3/projects/4d60d10491e444cdbc0e978da47f161e => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:49.413564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.415996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.503664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82167ff0-07cd-4c2d-95c7-02a575fe2388 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.545860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b53cc-3b9f-4a86-859a-79e2828f4a6f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.572749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.573585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.582981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.583131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.584126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.585773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.599723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.601098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.601098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.601098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] PATH_INFO: `/v3/users/df2e0917abf846de9f568cf0f201a708` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.604270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df2e0917abf846de9f568cf0f201a708)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.608525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.638101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1056/2077] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:49 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:49.643516 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.644128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.662108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:49.670807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454d5d2-7bcf-4e9a-a722-03245346ac25 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.680235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.681032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.681421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.681802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.682594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.687899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.688177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df2e0917abf846de9f568cf0f201a708'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.698910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df2e0917abf846de9f568cf0f201a708'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.701698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:49.707559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1057/2078] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:54:49.708520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.716624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.729567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df2e0917abf846de9f568cf0f201a708'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.730495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df2e0917abf846de9f568cf0f201a708'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.735699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539bccd6-f0e0-4905-8455-a1c40d79d50d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.740907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df2e0917abf846de9f568cf0f201a708'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.742344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.743129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.743485 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.743878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] PATH_INFO: `/v3/users/af768a9224e3408ab757ce228828e41a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.746399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af768a9224e3408ab757ce228828e41a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.749308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1022/2079] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:49 2022] DELETE /identity/v3/users/df2e0917abf846de9f568cf0f201a708 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:49.750122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.753993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.754994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.821043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af768a9224e3408ab757ce228828e41a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.830990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af768a9224e3408ab757ce228828e41a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.832574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af768a9224e3408ab757ce228828e41a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.850107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af768a9224e3408ab757ce228828e41a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.853579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8434c4-7028-4b38-9e68-828de08f5fc9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.858387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.860019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.860367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.860514 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1b772dfa-b23a-4c58-924d-171ad7e01874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af768a9224e3408ab757ce228828e41a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:49.860620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] PATH_INFO: `/v3/projects/67c6bc368dc749cda57fb8bc05060037/users/b8e5f68f20454a72b747ac539a44215e/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.869347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1058/2080] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:49 2022] DELETE /identity/v3/users/af768a9224e3408ab757ce228828e41a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:49.874484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.874814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.875097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.877764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6bc368dc749cda57fb8bc05060037, user_id=b8e5f68f20454a72b747ac539a44215e, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.880591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:49.896681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1023/2081] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:49 2022] PUT /identity/v3/projects/67c6bc368dc749cda57fb8bc05060037/users/b8e5f68f20454a72b747ac539a44215e/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:49.897254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:49.898550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.900583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.902863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.966612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1059/2082] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:49.977417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:49.978991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:49.982141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62656dc9-1616-4416-af52-2589c5128ed1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:49.990099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:49.991030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:49.991388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:49.991774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:49.992534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:49.994286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.010548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1024/2083] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:50.012849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:50.025047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7b989-421c-4b7a-afb5-53bf61b87e0e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:50.035038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:50.036614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.036880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.037155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] PATH_INFO: `/v3/projects/67c6bc368dc749cda57fb8bc05060037/users/b8e5f68f20454a72b747ac539a44215e/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.039154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c6bc368dc749cda57fb8bc05060037, user_id=b8e5f68f20454a72b747ac539a44215e, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:50.042025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c1f82-4120-4425-9c2f-866e0c266034 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.052043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14789cfd-03ee-47d1-913c-3aeb96909474 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:50.055130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1025/2084] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:50 2022] PUT /identity/v3/projects/67c6bc368dc749cda57fb8bc05060037/users/b8e5f68f20454a72b747ac539a44215e/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:50.065963 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.066258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.066543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.086845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:50.095724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:50.100069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] MFA Rules not processed for user `b8e5f68f20454a72b747ac539a44215e`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:50.102624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.119065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:50.119680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.119959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.120232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.189041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:50.190562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.193717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1026/2085] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:50.207011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1060/2086] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:50.223091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:50.226784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.295955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75f2b12-48bc-494e-8019-8ca6be7cdf72 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:50.300077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:50.300695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.300979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.301365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.311976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:50.313714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.327931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1027/2087] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:50 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:50.508605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:50.510225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.529484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790bafef-d1cc-4e7e-b280-0e205c21fc1e service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:50.544640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:50.546640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.547390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.548070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] PATH_INFO: `/v3/projects/1eff9979509c4d1a888f54e80d5cf342` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.551390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eff9979509c4d1a888f54e80d5cf342)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:50.557781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.670939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:50.672972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.674429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eff9979509c4d1a888f54e80d5cf342', 'request_id': 'req-085cb4bf-9284-437c-a5f7-19bda2022fe9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.686310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eff9979509c4d1a888f54e80d5cf342', 'request_id': 'req-085cb4bf-9284-437c-a5f7-19bda2022fe9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.697175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eff9979509c4d1a888f54e80d5cf342', 'request_id': 'req-085cb4bf-9284-437c-a5f7-19bda2022fe9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.699437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66d0573-60fa-4f83-a795-e6838afb55c0 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:50.714740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] The token cache is being invalidate because project 1eff9979509c4d1a888f54e80d5cf342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:50.715042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.715759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-085cb4bf-9284-437c-a5f7-19bda2022fe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.717450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1061/2088] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:50 2022] DELETE /identity/v3/projects/1eff9979509c4d1a888f54e80d5cf342 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:50.724640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.724872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.725192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.778383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:50.779658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.807927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:50.809309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.809538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.809850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] PATH_INFO: `/v3/projects/24d494c60b514236a39f31ea4be6d2da` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.811093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d494c60b514236a39f31ea4be6d2da)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:50.814027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:50.882942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:50.889394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d494c60b514236a39f31ea4be6d2da', 'request_id': 'req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.904732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d494c60b514236a39f31ea4be6d2da', 'request_id': 'req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.927162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d494c60b514236a39f31ea4be6d2da', 'request_id': 'req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.938271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1062/2089] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:50.939616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:50.941088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] The token cache is being invalidate because project 24d494c60b514236a39f31ea4be6d2da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:50.941394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.942132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-87d11d1b-a9a6-4bb1-b894-9dd31f90673f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:50.943823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1028/2090] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:50 2022] DELETE /identity/v3/projects/24d494c60b514236a39f31ea4be6d2da => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:50.945142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:50.950043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:50.950607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:50.951852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:50.953428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:50.992153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:50.993454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.083410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb8759-fdfd-477c-9a09-08480c46eea1 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.113442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1029/2091] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:51.115241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.117609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.139581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b52d8-6a89-4989-86d9-1f1344483946 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.146487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.147434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.147795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.148312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] PATH_INFO: `/v3/users/e066102e33994eae8eb7bc3bd8395703` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.149423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e066102e33994eae8eb7bc3bd8395703)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.151766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.210188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5f68f20454a72b747ac539a44215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6bc368dc749cda57fb8bc05060037', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.211016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.211312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.211748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.213268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:51.213911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.216477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.226368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e066102e33994eae8eb7bc3bd8395703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.231204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1063/2092] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:51.234978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.239865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e066102e33994eae8eb7bc3bd8395703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.254457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b291-bc6c-416a-85ef-88136ff59607 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.259628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e066102e33994eae8eb7bc3bd8395703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.259778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.260448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.260741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.261073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.261753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e066102e33994eae8eb7bc3bd8395703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.262101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:51.262418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.264994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.275818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e066102e33994eae8eb7bc3bd8395703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.281263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1064/2093] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:51.282221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.284385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.289077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1030/2094] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:51 2022] DELETE /identity/v3/users/e066102e33994eae8eb7bc3bd8395703 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:51.290136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.293602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.307093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93e2ad-25d5-46b4-ab29-52b6c67d8755 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.398266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:51.435545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2dc140-d7cf-4bb3-92da-0d7abe99b5ed admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.443930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.444737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.445220 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.445531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.446909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.451739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.462179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5f68f20454a72b747ac539a44215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6bc368dc749cda57fb8bc05060037', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.463176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.463648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.464171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.465067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.469951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.493242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1031/2095] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:51 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:51.498647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.533997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1065/2096] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:51 2022] POST /identity/v3/projects => generated 352 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:51.535273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.581249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c53ae32-c0dd-4de9-b614-7c37d5901101 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.586843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:51.649439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af9859-54c2-4fe7-9431-b681fa89ae69 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.653571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.654413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.654763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.655197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.655973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.658554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.663166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5f68f20454a72b747ac539a44215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6bc368dc749cda57fb8bc05060037', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.666362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.666657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.666943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.668152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:51.668466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.674876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.695625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1066/2097] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:51.703244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1032/2098] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:51 2022] POST /identity/v3/users => generated 285 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:51.707646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.715708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.720575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.744688 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e686-160b-473f-8fa3-4cf57ca4533e tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.748231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0697a213-7575-42cb-9034-1a0e7d1c376e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.754437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.755102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.755432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.755608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.755719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] PATH_INFO: `/v3/projects/34534931e9ed4e8f94220b6b9acce4c1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.756353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.756647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.756848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34534931e9ed4e8f94220b6b9acce4c1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.757260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.758499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.759006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.760968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.781989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1067/2099] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:51.782869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.794104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5b206-e42f-4212-9386-a80e3b41eb77 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.799545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8e5f68f20454a72b747ac539a44215e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '67c6bc368dc749cda57fb8bc05060037', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:51.800246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.800537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.800852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] PATH_INFO: `/v3/projects/6186f7892bbe45b1abc35a41dcb582d1` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.804602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6186f7892bbe45b1abc35a41dcb582d1)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:51.806577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:51.840237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34534931e9ed4e8f94220b6b9acce4c1', 'request_id': 'req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.849317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34534931e9ed4e8f94220b6b9acce4c1', 'request_id': 'req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.856586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:51.861109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34534931e9ed4e8f94220b6b9acce4c1', 'request_id': 'req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.875822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6186f7892bbe45b1abc35a41dcb582d1', 'request_id': 'req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.880211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] The token cache is being invalidate because project 34534931e9ed4e8f94220b6b9acce4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:51.880954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.882203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.884489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1033/2100] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:51 2022] DELETE /identity/v3/projects/34534931e9ed4e8f94220b6b9acce4c1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:51.886059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:51.888364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:51.889701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6186f7892bbe45b1abc35a41dcb582d1', 'request_id': 'req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.897774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6186f7892bbe45b1abc35a41dcb582d1', 'request_id': 'req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.917346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] The token cache is being invalidate because project 6186f7892bbe45b1abc35a41dcb582d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:51.918418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.920058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-459531ab-6e90-40b8-8ed8-dc9a4ffefbf8 tempest-VolumeQuotaClassesTest-1077132494 tempest-VolumeQuotaClassesTest-1077132494-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:51.922553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1068/2101] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:51 2022] DELETE /identity/v3/projects/6186f7892bbe45b1abc35a41dcb582d1 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:51.924169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6e8d-bc35-46b4-a682-dcb7f952de88 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:51.924761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6e8d-bc35-46b4-a682-dcb7f952de88 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:51.925293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e6e8d-bc35-46b4-a682-dcb7f952de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:51.966305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ceb1f-9b09-46b3-84c2-5ce9f4b8e2d1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:51.991208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d60e6e8d-bc35-46b4-a682-dcb7f952de88 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:51.996110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d60e6e8d-bc35-46b4-a682-dcb7f952de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.061268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.061910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.062188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.064780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.066544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.071396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.093415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1034/2102] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:52.101652 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.103744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.112566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1069/2103] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:52.121985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0760-3112-495a-95cd-5806f26af671 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.122506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0760-3112-495a-95cd-5806f26af671 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.122967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e0760-3112-495a-95cd-5806f26af671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.137103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e544-3bd7-44ca-b9e2-70964ffd7a49 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.151226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.151825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-771e0760-3112-495a-95cd-5806f26af671 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:52.152510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.153667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-771e0760-3112-495a-95cd-5806f26af671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.154207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.154560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] PATH_INFO: `/v3/projects/2673a5e8e2774b258288b2942873893d/users/cebde74a0c0042c08df47f5e9dde74d8/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.184336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2673a5e8e2774b258288b2942873893d, user_id=cebde74a0c0042c08df47f5e9dde74d8, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.187200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8d67-97d2-42f8-a22d-ea39683d5cf2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.190145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1070/2104] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:52.193317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0760-3112-495a-95cd-5806f26af671 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.210014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1035/2105] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:52 2022] PUT /identity/v3/projects/2673a5e8e2774b258288b2942873893d/users/cebde74a0c0042c08df47f5e9dde74d8/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:52.217077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e0760-3112-495a-95cd-5806f26af671 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.221279 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.221561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.221837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.246854 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:52.256045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] MFA Rules not processed for user `cebde74a0c0042c08df47f5e9dde74d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:52.257311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.341644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.342527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.343216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.343563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.344504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:52.344944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.346579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.363452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1071/2106] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:52.366195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.368248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.373414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:52.383200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fd08f-67c1-42eb-950e-d9b89c004cb1 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.388756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1036/2107] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:52.390382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.410641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7ce916-b497-4162-8a26-e3582fdf80cd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.411137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.411827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.412139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.412387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] PATH_INFO: `/v3/users/b7d64e5cd4824d2d8506b56e9b6d8688` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.415516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.416125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.416402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.416672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.417309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.419398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d64e5cd4824d2d8506b56e9b6d8688)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.419880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.421743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.457984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1037/2108] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:52 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:52.457984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.457984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.544316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d64e5cd4824d2d8506b56e9b6d8688'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:52.555405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d64e5cd4824d2d8506b56e9b6d8688'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:52.556063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d64e5cd4824d2d8506b56e9b6d8688'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:52.574488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d64e5cd4824d2d8506b56e9b6d8688'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:52.585441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d64e5cd4824d2d8506b56e9b6d8688'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:52.586199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868f7a8-7e92-4834-bfca-af9ba85476bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.593058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1072/2109] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:52 2022] DELETE /identity/v3/users/b7d64e5cd4824d2d8506b56e9b6d8688 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:52.593897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.594215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.595636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.595939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.596113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.596487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.598876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.684940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.686455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef274d-6fc0-4056-8295-a62b27f1efc6 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.689468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c1ef1f-bf5b-4e05-84fa-6b313f48e2ee admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.695864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.696563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.696975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.697509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.697628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1038/2110] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:52.698070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.698638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.698996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.699278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.700361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.721074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:52.726616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.737841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1073/2111] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:52 2022] POST /identity/v3/users => generated 292 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:52.738737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.749111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1039/2112] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:52.752344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286e697-bad6-4516-b294-4fd9d76a44ca admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.759185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.761045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:52.764752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.765633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.766116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.766499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.767353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.771990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.795317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:52.817433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1074/2113] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:52.834303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.851009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947854-3b8f-436d-832a-4b59c2ab20e6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.868681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.869322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.869612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.870073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.880897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.884680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.906973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1075/2114] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:52.908935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ef7be-c0ee-4434-a2d5-13d381935980 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.911096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:52.914209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.915538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.916121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.916487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.929513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.931242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8338b-0463-49a3-98da-35d6764c8ab8 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:52.938511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b714ea37-1bc5-42a7-bfac-5bba7ac7f63c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:52.944458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1040/2115] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:52.955345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:52.956270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:52.956752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:52.957282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] PATH_INFO: `/v3/projects/a457c8e8df8f4f25a20de44bcebf7126/users/fc34cdd59a2d40c595aa5ba3f13a7d65/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:52.979250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a457c8e8df8f4f25a20de44bcebf7126, user_id=fc34cdd59a2d40c595aa5ba3f13a7d65, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:52.982823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:53.014823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1076/2116] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:52 2022] PUT /identity/v3/projects/a457c8e8df8f4f25a20de44bcebf7126/users/fc34cdd59a2d40c595aa5ba3f13a7d65/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:53.024937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.025282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.025922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.046807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:53.066997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] MFA Rules not processed for user `fc34cdd59a2d40c595aa5ba3f13a7d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:53.068782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.187123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1041/2117] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:53.199243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:53.202902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.303076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f71ef-bf74-464f-972a-bf3e66cfd21c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:53.316954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:53.317795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.318373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.318806 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.343388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:53.345300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:53.356003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1077/2118] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:54:53.365393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:53.368450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.395166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:53.493826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29872ffd-1868-473e-b869-16b5a97e5de5 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:53.500006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847a1c8-d16d-4fd3-8ae2-4294f74351fc None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:53.505150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:53.506465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.506753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.507033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] PATH_INFO: `/v3/users/fc34cdd59a2d40c595aa5ba3f13a7d65` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.508706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc34cdd59a2d40c595aa5ba3f13a7d65)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:53.510689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:53.515438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:53.516227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.516443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.516731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] PATH_INFO: `/v3/projects/705702811e084c4595ea23dbb56f0064` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.518679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] RBAC: Authorizing `identity:delete_project(project_id=705702811e084c4595ea23dbb56f0064)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:53.520638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:53.584480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705702811e084c4595ea23dbb56f0064', 'request_id': 'req-5cc7401c-19f7-440c-8938-573c06cf026e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.597858 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705702811e084c4595ea23dbb56f0064', 'request_id': 'req-5cc7401c-19f7-440c-8938-573c06cf026e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.605325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705702811e084c4595ea23dbb56f0064', 'request_id': 'req-5cc7401c-19f7-440c-8938-573c06cf026e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.622196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] The token cache is being invalidate because project 705702811e084c4595ea23dbb56f0064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:53.622643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.623416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.628985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1042/2119] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:53 2022] DELETE /identity/v3/projects/705702811e084c4595ea23dbb56f0064 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:53.629338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc34cdd59a2d40c595aa5ba3f13a7d65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.630522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:53.631741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.641702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc34cdd59a2d40c595aa5ba3f13a7d65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.642936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc34cdd59a2d40c595aa5ba3f13a7d65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.671487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:53.672733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc34cdd59a2d40c595aa5ba3f13a7d65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.684645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:53.696834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29a706ca-2c17-46e4-b735-b4631f3f9112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc34cdd59a2d40c595aa5ba3f13a7d65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:53.706999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1078/2120] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:53 2022] DELETE /identity/v3/users/fc34cdd59a2d40c595aa5ba3f13a7d65 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:53.712007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.712179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.712329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.744168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:53.746336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.763024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc7401c-19f7-440c-8938-573c06cf026e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:53.877285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:53.878403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:53.878968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:53.879256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] PATH_INFO: `/v3/users/b8e5f68f20454a72b747ac539a44215e` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:53.889313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e5f68f20454a72b747ac539a44215e)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:53.890779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:53.894110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1079/2121] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:53.909077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:53.909077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:53.988970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e5f68f20454a72b747ac539a44215e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.001347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e5f68f20454a72b747ac539a44215e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.024722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e5f68f20454a72b747ac539a44215e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.026790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e5f68f20454a72b747ac539a44215e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.039678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e5f68f20454a72b747ac539a44215e'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.052433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1043/2122] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:53 2022] DELETE /identity/v3/users/b8e5f68f20454a72b747ac539a44215e => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:54.076572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d272e-a3aa-4b5e-8bb6-99a27bd02055 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:54.177471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:54.178656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:54.179006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:54.179359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:54.181793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:54.290857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:54.304094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:54.306184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:54.332006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1080/2123] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:54.588426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:54.590752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:54.614140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b60f8-9220-4276-9288-cce36e89ebe8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:54.618996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:54.630630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:54.632073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:54.632358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] PATH_INFO: `/v3/projects/67c6bc368dc749cda57fb8bc05060037` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:54.642699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c6bc368dc749cda57fb8bc05060037)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:54.644676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:54.711848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:54.714903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c6bc368dc749cda57fb8bc05060037', 'request_id': 'req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.728426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c6bc368dc749cda57fb8bc05060037', 'request_id': 'req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.739471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:54.740944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:54.742825 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c6bc368dc749cda57fb8bc05060037', 'request_id': 'req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.755603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b56db9-0a5d-446a-82cb-2becdf3760a5 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:54.762793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] The token cache is being invalidate because project 67c6bc368dc749cda57fb8bc05060037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:54.763214 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.764002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e18dae8b-a1dc-4b67-89c6-9c7d2d5b7417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.771792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1044/2124] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:54 2022] DELETE /identity/v3/projects/67c6bc368dc749cda57fb8bc05060037 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:54.773368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:54.773758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:54.774161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:54.801956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:54.803423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:54.872167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:54.875378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:54.875735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:54.877217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] PATH_INFO: `/v3/users/8635a72ff3f74b6c89b841a2fcefbb07` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:54.879682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8635a72ff3f74b6c89b841a2fcefbb07)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:54.882360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:54.901297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1045/2125] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:54.902243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:54.903534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:54.917683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec0a2cc-cf6c-4ee7-a059-d1ae3bf84a46 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:54.923332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:54.923987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:54.924245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:54.924535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] PATH_INFO: `/v3/projects/a457c8e8df8f4f25a20de44bcebf7126` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:54.925791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a457c8e8df8f4f25a20de44bcebf7126)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:54.928030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:54.952076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8635a72ff3f74b6c89b841a2fcefbb07'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.962231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8635a72ff3f74b6c89b841a2fcefbb07'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.963286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8635a72ff3f74b6c89b841a2fcefbb07'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.983251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8635a72ff3f74b6c89b841a2fcefbb07'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.992863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-993e5029-e82e-4483-9a27-c530b684a080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8635a72ff3f74b6c89b841a2fcefbb07'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:54.993254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a457c8e8df8f4f25a20de44bcebf7126', 'request_id': 'req-9c5d2248-f19e-4532-8b63-c3a450ac7099'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.001622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1081/2126] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:54:54 2022] DELETE /identity/v3/users/8635a72ff3f74b6c89b841a2fcefbb07 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:54:55.003467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.003811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.004148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.019065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a457c8e8df8f4f25a20de44bcebf7126', 'request_id': 'req-9c5d2248-f19e-4532-8b63-c3a450ac7099'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.032631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a457c8e8df8f4f25a20de44bcebf7126', 'request_id': 'req-9c5d2248-f19e-4532-8b63-c3a450ac7099'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.049464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.050568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.052792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] The token cache is being invalidate because project a457c8e8df8f4f25a20de44bcebf7126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:55.053791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.055288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9c5d2248-f19e-4532-8b63-c3a450ac7099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.058615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1046/2127] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:54 2022] DELETE /identity/v3/projects/a457c8e8df8f4f25a20de44bcebf7126 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:55.066186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542758-bde4-43f0-944b-d9ba1909477a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.066474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542758-bde4-43f0-944b-d9ba1909477a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.066749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab542758-bde4-43f0-944b-d9ba1909477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.091545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ab542758-bde4-43f0-944b-d9ba1909477a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.092798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab542758-bde4-43f0-944b-d9ba1909477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.156656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1082/2128] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:55.160226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.172933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e7f59-921b-4dc4-91b3-0b1421c01777 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.179403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.180149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.180680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.181060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.182120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:55.182252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:55.182596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.185001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.195212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1047/2129] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:55.205474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.205765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.206062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.217775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1083/2130] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:55.218339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:55.221971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.235906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ca490-1410-4603-ae85-226b04367e99 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.237150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.238804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.242344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.243368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.243699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.244072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.244973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.247705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.253914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1048/2131] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:54:55.254896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.272553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3cd60-26c1-4423-af46-34c6663302c1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.286987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.287750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.288056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.288451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.289120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:55.289560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.291298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.294884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1084/2132] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/projects => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:55.299063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.334785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1049/2133] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:55.334785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.340185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.369047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780829c-dc2c-4785-be78-514f1bdfb660 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.410640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c5b08-624f-4e5d-812a-7613ff20b584 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.416682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.417580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.418075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.418591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.419489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.421573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.447854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.448498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.449303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.449581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] PATH_INFO: `/v3/projects/b8c08398ef794ebc9e10efd1a7e9c1eb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.453650 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1085/2134] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/users => generated 284 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:54:55.453796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c08398ef794ebc9e10efd1a7e9c1eb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.453916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.454035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.462777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cabc54c-c98e-492a-af69-e5b28fcb7b85 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.468130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.468839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.469194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.469476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.470150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.472262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.506307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1086/2135] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:55.506307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.510421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c08398ef794ebc9e10efd1a7e9c1eb', 'request_id': 'req-d3fe292b-f67f-41a3-a585-a3d55bc5259b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.522478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c08398ef794ebc9e10efd1a7e9c1eb', 'request_id': 'req-d3fe292b-f67f-41a3-a585-a3d55bc5259b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.530778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c08398ef794ebc9e10efd1a7e9c1eb', 'request_id': 'req-d3fe292b-f67f-41a3-a585-a3d55bc5259b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.556991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] The token cache is being invalidate because project b8c08398ef794ebc9e10efd1a7e9c1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:54:55.557501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.558408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:54:55.560092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1050/2136] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:54:55 2022] DELETE /identity/v3/projects/b8c08398ef794ebc9e10efd1a7e9c1eb => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:55.560909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.562365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.579129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcc9a-4f61-4f56-badb-e7501abe17cf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.583881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.584487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.584772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.585049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.585696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.587319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c463e-05dd-4bce-9040-7b2be0af8df8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.600891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1087/2137] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:55.600891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.600891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.600891 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.621082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.622420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.630153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fe292b-f67f-41a3-a585-a3d55bc5259b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.632225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1088/2138] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:55.633066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.640369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.643101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.643797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.644012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.644286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.644928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.646903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.653551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcba6c8-eee6-42f8-b2d4-0104ce14c125 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.658255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.658941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.659208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.659477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.660204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.661785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5344b0-ac0c-4c01-8df0-691652ffdf12 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.669312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:55.673253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1089/2139] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:55.674500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.674783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.678122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.678361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1051/2140] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:55.678361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.688460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e547c-6808-4fe8-a3bd-f85b0e208e02 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.693740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.694431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.694708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.694980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] PATH_INFO: `/v3/projects/c047583d907740acbc8327def9d75572/users/abc315a6c52446b595437c36a639a918/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.696469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.697687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.705576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1090/2141] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:55.706475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.713073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c047583d907740acbc8327def9d75572, user_id=abc315a6c52446b595437c36a639a918, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.716478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.717202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70ed31-9c1f-4d7b-843f-909efff57ef7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.721999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.722591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.722941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.723164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.723790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.725356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8acaa7-94da-421c-a19f-c3ec0dcf2466 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.730164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1052/2142] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:55 2022] PUT /identity/v3/projects/c047583d907740acbc8327def9d75572/users/abc315a6c52446b595437c36a639a918/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:55.731049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.743130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1091/2143] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:55.744651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.745022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.745367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.759536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:55.775369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] MFA Rules not processed for user `abc315a6c52446b595437c36a639a918`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:55.776678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:55.799939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880ff24-a2a5-4d4d-8a65-c669ce376b61 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.805094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.805845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.806152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.806426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.807237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:54:55.807353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.809473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.821898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1053/2144] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:54:55.822691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.832273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a121da6-c32b-4ec7-842e-7cd6cafa8f6f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.837358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.838107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.838277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.838549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.841896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.841896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.846384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1092/2145] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:55.847302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.854155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1054/2146] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:55.855723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.862060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d346d438-5d89-426e-a842-2aeb403bc12b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.867305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.867925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.868209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.868488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.868633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0e32d-66b9-4872-8557-bf92dae2727d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.869195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.871188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.873491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.874135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.874411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.874683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.875310 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.877283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.900729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1093/2147] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:55.901553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.908057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1055/2148] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:55.908057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:55.965577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a68638-c4f2-47a5-adc2-5299ead95000 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.970370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.971003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6851a37-1ef5-4e32-b924-072d196a812f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:55.971117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.971301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.971580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] PATH_INFO: `/v3/projects/7798c9a3541e4c3da5452b578a194aeb/users/5a3ed60d69954a868c519a42d04ad0ab/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.975699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:55.976299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:55.976576 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:55.976848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:55.977473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.979423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:55.986041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7798c9a3541e4c3da5452b578a194aeb, user_id=5a3ed60d69954a868c519a42d04ad0ab, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:55.988690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.004404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1056/2149] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:55 2022] POST /identity/v3/users => generated 295 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:56.005367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.005821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1094/2150] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:55 2022] PUT /identity/v3/projects/7798c9a3541e4c3da5452b578a194aeb/users/5a3ed60d69954a868c519a42d04ad0ab/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:56.010795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.018020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e339e-278c-4928-b0fc-5b0d10f8cebe admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.044225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:56.076137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:56.078008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.078621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.078902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.079190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.079802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.080752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7951cc8c-ce1c-4a9f-98fa-d9d9be9aab9e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.081733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.086745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.087434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.087792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.088140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.088857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.090609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b42690-bc62-4128-a1cd-1f79cf4839f2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.100823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1095/2151] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:56.102110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.102471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.102812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.102999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1057/2152] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:54:56 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:54:56.104691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.114985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9d61bf-aa1b-476e-ac86-3d39cd37cde8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.119680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.120267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.120545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.120894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.121530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.123210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.138166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1058/2153] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:56.138404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] MFA Rules not processed for user `5a3ed60d69954a868c519a42d04ad0ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:56.138528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.138618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.145148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49ca32-b02b-42a8-865a-39182c2b0a08 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.150135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.150719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.150998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.151270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.151976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.153555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.163725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1059/2154] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:56.164553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.176045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f370c-dc24-4062-b5d4-8df0ab540256 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.180885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.181741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.182047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.182322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] PATH_INFO: `/v3/projects/309262b0028e46e9a9d08b7652060c02/users/a1f0fb63df7642eba4d93fc5d713c704/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.201339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=309262b0028e46e9a9d08b7652060c02, user_id=a1f0fb63df7642eba4d93fc5d713c704, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.204305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb96e9-a6b6-471f-aedc-8d94153a3000 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.221832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1060/2155] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:56 2022] PUT /identity/v3/projects/309262b0028e46e9a9d08b7652060c02/users/a1f0fb63df7642eba4d93fc5d713c704/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:56.222066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1096/2156] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:56.222066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.225441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.225732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.226353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.239587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe1739-c149-4740-97ba-6a0797befe4e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.255053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:56.256426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.328498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1061/2157] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:56.329665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.331231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.341102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.341775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.342086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.342358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] PATH_INFO: `/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1/users/5176dd8df02a4132bf65009149f0bcf2/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.358790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea2a4eb2236478fa72fb15c8acc93d1, user_id=5176dd8df02a4132bf65009149f0bcf2, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.361411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.379476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1097/2158] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:56 2022] PUT /identity/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1/users/5176dd8df02a4132bf65009149f0bcf2/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:56.382544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.385224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.411782 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef7563-a1d9-4336-9dbb-389f99dc2e8a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.440556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:56.469109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011cf97-2f00-474e-936a-b4714970bdc8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.469566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.470309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.470489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.470746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.473255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.473955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.474317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.474660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.497536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:56.554895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.556505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.562361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.564061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.570261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1098/2159] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:56.571025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.579123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1062/2160] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:56.580954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb584cc-42f0-4c1c-a4ea-1d7779ee4f44 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.585843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.586474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.586758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.587078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.587658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.589429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17794bfb-d553-4618-98d6-a30290757412 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.601907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1099/2161] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:54:56.606695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.626182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64234837-a0e7-4882-ab7e-81f65bdf67f6 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.631266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.632031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.632316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.632592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] PATH_INFO: `/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1/users/5176dd8df02a4132bf65009149f0bcf2/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.635024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea2a4eb2236478fa72fb15c8acc93d1, user_id=5176dd8df02a4132bf65009149f0bcf2, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:56.638929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:56.662119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1063/2162] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:54:56 2022] PUT /identity/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1/users/5176dd8df02a4132bf65009149f0bcf2/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:54:56.673058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.674134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.674134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:56.727865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] MFA Rules not processed for user `5176dd8df02a4132bf65009149f0bcf2`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:54:56.729500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.882155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1100/2163] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:54:56 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:54:56.912286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:56.914856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:54:56.987481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895e69b-46b3-4985-aca8-da6a5b7f6eb4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:56.991766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:56.992491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:56.992841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:56.993221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:57.003818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:57.005552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100723f6-9770-41e1-afa9-fe998368e42a service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:57.018212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1064/2164] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:56 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:54:57.142320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:54:57.153059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cebbd7-affa-4ef6-ad04-d4430b02de2b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:54:57.157477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:54:57.158380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:54:57.158893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:54:57.159311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:54:57.282918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:54:57.284318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:54:57.296281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1101/2165] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:54:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:01.941099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:01.941633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:01.941809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:01.982592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] MFA Rules not processed for user `a1f0fb63df7642eba4d93fc5d713c704`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:01.984019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:02.064910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:02.070792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1065/2166] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:02.087733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:02.090155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:02.146212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:02.194751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6446d-0117-4883-b78a-d43121175a41 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:02.210322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:02.210951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:02.211233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:02.211507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:02.220869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:02.222686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20365c5a-f320-406a-8e23-b2716487c758 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:02.234791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1102/2167] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:02.272254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:02.349766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2aaca3-50b7-4f7b-a0fd-e7e01fbb0456 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:02.355577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:02.356887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:02.357361 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:02.357820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] PATH_INFO: `/v3/users/5a3ed60d69954a868c519a42d04ad0ab` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:02.359404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3ed60d69954a868c519a42d04ad0ab)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:02.361482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:02.470603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3ed60d69954a868c519a42d04ad0ab'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:02.480046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3ed60d69954a868c519a42d04ad0ab'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:02.510306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3ed60d69954a868c519a42d04ad0ab'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:02.511436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3ed60d69954a868c519a42d04ad0ab'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:02.520781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3ed60d69954a868c519a42d04ad0ab'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:02.550453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1066/2168] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:02 2022] DELETE /identity/v3/users/5a3ed60d69954a868c519a42d04ad0ab => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:02.552545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:02.552741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:02.553026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:02.594658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:02.596469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:02.766930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1103/2169] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:02.774794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:02.776380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:02.886880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:02.890590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:02.914933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9d5c-66da-42cc-9b0e-f69ce7d31216 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:02.924308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc1589-e746-4f3e-a575-658e8e5649e9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:02.931642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:02.932300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:02.932587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:02.932942 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] PATH_INFO: `/v3/users/abc315a6c52446b595437c36a639a918` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:02.935251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc315a6c52446b595437c36a639a918)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:02.935977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:02.936658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:02.936929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:02.937199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:02.943288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:02.966170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:02.967670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddefece-abbb-4dbb-8694-43fcfd5bc69d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:03.013093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1067/2170] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:03.075347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc315a6c52446b595437c36a639a918'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:03.093053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc315a6c52446b595437c36a639a918'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:03.094805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc315a6c52446b595437c36a639a918'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:03.133144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc315a6c52446b595437c36a639a918'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:03.155665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc315a6c52446b595437c36a639a918'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:03.164845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1104/2171] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:02 2022] DELETE /identity/v3/users/abc315a6c52446b595437c36a639a918 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:03.170819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:03.171389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:03.171784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:03.198259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:03.199678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:03.226965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:03.331028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1068/2172] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:03.347081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:03.348398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:03.397127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:03.454740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e076ff5-4cab-416d-ad01-d7b7ad20c70d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:03.459062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:03.459755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:03.460041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:03.460336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:03.471763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:03.473205 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:03.488371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1105/2173] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:55:03.938203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:03.939686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:03.953232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe7a332-d65a-4b8e-8328-916ea6a92726 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:03.958759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:03.959822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:03.960349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:03.960657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] PATH_INFO: `/v3/projects/c047583d907740acbc8327def9d75572` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:03.961997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c047583d907740acbc8327def9d75572)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:03.964549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:04.050652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:04.052150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.062856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c047583d907740acbc8327def9d75572', 'request_id': 'req-41d6c8be-55e6-4765-b4cc-9b755f45502b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.076588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c047583d907740acbc8327def9d75572', 'request_id': 'req-41d6c8be-55e6-4765-b4cc-9b755f45502b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.086481 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc4535-d79f-47bc-8d12-eb2f3e0406b6 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:04.087117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c047583d907740acbc8327def9d75572', 'request_id': 'req-41d6c8be-55e6-4765-b4cc-9b755f45502b'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.104754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] The token cache is being invalidate because project c047583d907740acbc8327def9d75572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:04.105057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.105795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.107803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1069/2174] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:03 2022] DELETE /identity/v3/projects/c047583d907740acbc8327def9d75572 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:04.112691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:04.116398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.209119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:04.210609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.211110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.211593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] PATH_INFO: `/v3/projects/7798c9a3541e4c3da5452b578a194aeb` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.212955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7798c9a3541e4c3da5452b578a194aeb)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:04.216363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:04.221346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c8be-55e6-4765-b4cc-9b755f45502b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:04.229735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:04.230536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.230821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.231399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] PATH_INFO: `/v3/users/5176dd8df02a4132bf65009149f0bcf2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.234681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5176dd8df02a4132bf65009149f0bcf2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:04.236795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:04.323804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7798c9a3541e4c3da5452b578a194aeb', 'request_id': 'req-6ca8ab30-a287-439c-bb81-3d9b26877743'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.326515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5176dd8df02a4132bf65009149f0bcf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.329660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:04.335325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7798c9a3541e4c3da5452b578a194aeb', 'request_id': 'req-6ca8ab30-a287-439c-bb81-3d9b26877743'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.353589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5176dd8df02a4132bf65009149f0bcf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.358265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7798c9a3541e4c3da5452b578a194aeb', 'request_id': 'req-6ca8ab30-a287-439c-bb81-3d9b26877743'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.376670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] The token cache is being invalidate because project 7798c9a3541e4c3da5452b578a194aeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:04.377071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.377840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ca8ab30-a287-439c-bb81-3d9b26877743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.379474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1106/2175] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:04 2022] DELETE /identity/v3/projects/7798c9a3541e4c3da5452b578a194aeb => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:55:04.387358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.388224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.388888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.390928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5176dd8df02a4132bf65009149f0bcf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.392650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5176dd8df02a4132bf65009149f0bcf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.413656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1bfd6554-1f1f-40e9-a282-2aad9e7cea19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5176dd8df02a4132bf65009149f0bcf2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.417631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:04.419089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.432050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1070/2176] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:04 2022] DELETE /identity/v3/users/5176dd8df02a4132bf65009149f0bcf2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:04.521193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:04.539821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1107/2177] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:04.541274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.541562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.541854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.567460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:04.569436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.702594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:04.704959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1071/2178] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:04.718520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d069b-f299-4cee-93a3-3b2af562a11a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:04.728021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:04.728889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.729227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.729536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.730268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:04.730576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:04.732321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d3abd-7b7a-49fa-a215-3a5d138b2c6a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:04.783066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1108/2179] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:55:04.797204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:04.798681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.799211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.800383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.801138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.813482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c2237-f145-4fcf-b16d-affb0ed3e343 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:04.818551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:04.819343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.819636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.820239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] PATH_INFO: `/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:04.821188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea2a4eb2236478fa72fb15c8acc93d1)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:04.823631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:04.844429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] MFA Rules not processed for user `a1f0fb63df7642eba4d93fc5d713c704`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:04.846196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:04.933888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea2a4eb2236478fa72fb15c8acc93d1', 'request_id': 'req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.941418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1109/2180] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:04.942456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:04.951230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea2a4eb2236478fa72fb15c8acc93d1', 'request_id': 'req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.956684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d2fec-2d11-437b-aa9a-58693efd8737 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:04.962721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea2a4eb2236478fa72fb15c8acc93d1', 'request_id': 'req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.981859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] The token cache is being invalidate because project bea2a4eb2236478fa72fb15c8acc93d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:04.982598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.983605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc55a371-7d1d-48b9-8ebb-d0ef1320f520 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:04.985859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1072/2181] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:04 2022] DELETE /identity/v3/projects/bea2a4eb2236478fa72fb15c8acc93d1 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:04.994804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b03a7-e7d8-419b-84b6-93d1d30863aa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:04.995430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b03a7-e7d8-419b-84b6-93d1d30863aa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:04.995886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992b03a7-e7d8-419b-84b6-93d1d30863aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.026349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-992b03a7-e7d8-419b-84b6-93d1d30863aa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:05.028178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-992b03a7-e7d8-419b-84b6-93d1d30863aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.045813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.046551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.046839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.047668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.048357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.050585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.084953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:05.091756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1110/2182] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:04 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:05.096260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.098260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.109920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1073/2183] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:05.118657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.119050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.119911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.144000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:05.145227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.171231 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49622be9-63be-4bd9-9154-9fc3d9d5f82b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.179223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.179223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.179223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.179537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.180252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.182416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.208686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1111/2184] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:05.213059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.223537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1074/2185] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:05.224055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f1572-3908-403e-8193-6c1310ea3586 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.227722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.229206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.230368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.230991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.231286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.231962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.233775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.237540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:05.238667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3dfb5d-d492-4235-bf5e-8d3ebe0d1a68 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.243765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.244402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.244684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.244959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.245702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:05.246058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.247725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.255976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1112/2186] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:05.257077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.262468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1075/2187] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:55:05.266891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.280727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a6dbb-a429-40a7-97b6-6344fc87d8c8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.281065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6756c3a-fd56-41b2-8ad8-ade7db68e7e0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.286891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.287520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.287812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.288096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.288912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.290938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.291395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.292015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.292357 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.292631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.293435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.295672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.308537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1113/2188] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:05.312961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.325017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1076/2189] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/projects => generated 377 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:05.329770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a1d60-ae90-4b38-b619-abe7bd18be9e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.331130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.405194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.405929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.406219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.406497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] PATH_INFO: `/v3/projects/c04921f688c742a58c90e221cfe87810/users/6d6e0871c846405fa60b355a987f9b2c/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.408653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef20b5-74f6-4c95-b8f1-845f91f18312 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.419902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.420705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.421080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.421676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.422893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.425161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.451738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04921f688c742a58c90e221cfe87810, user_id=6d6e0871c846405fa60b355a987f9b2c, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.456476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1077/2190] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/users => generated 289 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:05.456666 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aab2fd-7d7c-4fdd-b7ba-ba63dd67cef0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.457800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.493154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ca4a6-47f3-418c-a8ec-7307e93f4875 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.496002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1114/2191] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:05 2022] PUT /identity/v3/projects/c04921f688c742a58c90e221cfe87810/users/6d6e0871c846405fa60b355a987f9b2c/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:55:05.504052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.504642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.504929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.528762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:05.528762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.574118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:05.600525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.601164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.601447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.601727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.602879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.605003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.621386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1115/2192] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:05.622008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1078/2193] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:05.625651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.628684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.630702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.654910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f779ec2-2f1d-4df5-8feb-f6ad0de5ce81 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.662612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.663238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.663530 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.663810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.664466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.666281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.681207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1116/2194] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:05.685464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:05.699384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c543f925-3e4e-4205-b7e2-86696e2b497f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.705289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.706021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.706312 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.706598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] PATH_INFO: `/v3/projects/eb92b5aeab15467b861b1e4c34b1e109/users/38ccfbcfcd474ed8b57a84f68d3bbed8/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.739709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e924796-94f0-48b2-af46-0ef235a415d2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:05.744707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb92b5aeab15467b861b1e4c34b1e109, user_id=38ccfbcfcd474ed8b57a84f68d3bbed8, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.746729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:05.747417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.747703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.747917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc2e8e-afc1-44ca-9d3a-aca4d9c16e70 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.748049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.759492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:05.761792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:05.780719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1117/2195] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:05 2022] PUT /identity/v3/projects/eb92b5aeab15467b861b1e4c34b1e109/users/38ccfbcfcd474ed8b57a84f68d3bbed8/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:05.780939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1079/2196] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:55:05.782880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef40-f872-43e3-9e72-a031e09fd08d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:05.783174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef40-f872-43e3-9e72-a031e09fd08d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:05.783454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ceef40-f872-43e3-9e72-a031e09fd08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:05.816794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-26ceef40-f872-43e3-9e72-a031e09fd08d None None] MFA Rules not processed for user `38ccfbcfcd474ed8b57a84f68d3bbed8`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:05.822568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-26ceef40-f872-43e3-9e72-a031e09fd08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:05.846643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:05.916849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1118/2197] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:09.383054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:09.385369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:09.493325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67743d55-d210-4299-aaf6-eb9bc5fd6d6f service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:09.564374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:09.564999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:09.565282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:09.565762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:09.575975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:09.577486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:09.588316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1080/2198] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:10.541925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:10.541925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:10.541925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:10.615747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] MFA Rules not processed for user `6d6e0871c846405fa60b355a987f9b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:10.617192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:10.715617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1119/2199] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:10.719952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:10.789427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:10.815119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cf417-c86c-48be-acc3-02a897f0ae01 service glance] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:10.828090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:10.829101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:10.829570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:10.830186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:10.831066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:10.833021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:10.864142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1081/2200] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:10 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:10.868296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:10.883152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a919e051-95e8-4c11-a113-2edc80f7276f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:11.077941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:11.078701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:11.079049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:11.079391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:11.080112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:11.082518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:11.107742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1120/2201] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:10 2022] POST /identity/v3/users => generated 298 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:55:11.112090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:11.126435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d14a97-b85e-4a43-b38a-d0c8271fa34c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:11.134199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:11.135942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:11.135942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:11.135942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:11.137725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:11.142222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:11.160486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1082/2202] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:11.164978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:11.177480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfd927-a4e2-476a-ae42-43cd1098dca6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:11.182804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:11.183475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:11.183768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:11.184017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] PATH_INFO: `/v3/projects/96423abb2eff4a249a94697931e9b07f/users/19ae305f312e463ea33029c85fababf6/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:11.204194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96423abb2eff4a249a94697931e9b07f, user_id=19ae305f312e463ea33029c85fababf6, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:11.211665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:11.230212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1121/2203] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:11 2022] PUT /identity/v3/projects/96423abb2eff4a249a94697931e9b07f/users/19ae305f312e463ea33029c85fababf6/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:55:11.232556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:11.242605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d5b73-01b2-4cab-87e2-63b935703582 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:11.371334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:11.372363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:11.373155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:11.373697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:11.374591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:11.377233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268ca5df-70d8-47c5-a3c3-713b6bda68e6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:11.390112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1083/2204] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:11 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:11.394425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:11.407770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf966b8-09e8-4ffb-9867-aefb14101953 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:11.414726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:11.415398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:11.415717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:11.416046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] PATH_INFO: `/v3/projects/96423abb2eff4a249a94697931e9b07f/users/19ae305f312e463ea33029c85fababf6/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:11.418590 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96423abb2eff4a249a94697931e9b07f, user_id=19ae305f312e463ea33029c85fababf6, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:11.421910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:11.436800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1122/2205] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:11 2022] PUT /identity/v3/projects/96423abb2eff4a249a94697931e9b07f/users/19ae305f312e463ea33029c85fababf6/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:55:17.680190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56185f-87e8-4d41-a77f-fd01254ad208 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:17.681019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56185f-87e8-4d41-a77f-fd01254ad208 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:17.681461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56185f-87e8-4d41-a77f-fd01254ad208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:17.747890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-fb56185f-87e8-4d41-a77f-fd01254ad208 None None] MFA Rules not processed for user `19ae305f312e463ea33029c85fababf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:17.749648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-fb56185f-87e8-4d41-a77f-fd01254ad208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:17.913503 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1084/2206] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:21.432328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=93,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:21.609746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:21.612283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:21.686113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29acb9-aa03-41a7-b510-428d1e16f77c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:21.692886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:21.693775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:21.694338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:21.694836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:21.783078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:21.784849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:21.795062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1123/2207] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:21.973131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:21.973625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:21.973818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:21.993399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:21.995163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:22.031759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:22.063794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1085/2208] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:55:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:22.102104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:22.103586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:22.190814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281f6fa-abd6-4ae5-b3f1-ec409b486cf9 service glance] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:22.195953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:22.196581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:22.196864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:22.197135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:22.207146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:22.208739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f7bfe-a454-4e90-9c65-28a8bd2fb383 service swift] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:22.218553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1124/2209] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:23.735266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:23.741413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:23.832228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594757e-c8ba-4083-b2d5-c0ad16198d98 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:23.837113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:23.837750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:23.838101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:23.838961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] PATH_INFO: `/v3/users/cebde74a0c0042c08df47f5e9dde74d8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:23.841664 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebde74a0c0042c08df47f5e9dde74d8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:23.842222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:23.908921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebde74a0c0042c08df47f5e9dde74d8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:23.917558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebde74a0c0042c08df47f5e9dde74d8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:23.934789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebde74a0c0042c08df47f5e9dde74d8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:23.935524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebde74a0c0042c08df47f5e9dde74d8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:23.950322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebde74a0c0042c08df47f5e9dde74d8'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:23.958560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1086/2210] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:23 2022] DELETE /identity/v3/users/cebde74a0c0042c08df47f5e9dde74d8 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:23.962874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:23.964006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:23.964006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:23.995426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:23.996593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:24.064047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:24.096400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1125/2211] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:24.102531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:24.104272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:24.188709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e77e4b-4a13-465a-aa9f-976b12282df8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:24.194162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:24.194785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:24.195063 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:24.195332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:24.205594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:24.208260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72d6fbb-0cca-4889-8750-97ba69039170 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:24.219761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1087/2212] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:55:24.642498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:24.644017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:24.659447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031dd498-e331-48c8-ba4e-715a992aaa8a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:24.670695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:24.671361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:24.671643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:24.672304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] PATH_INFO: `/v3/projects/2673a5e8e2774b258288b2942873893d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:24.673457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2673a5e8e2774b258288b2942873893d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:24.675402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:24.740209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2673a5e8e2774b258288b2942873893d', 'request_id': 'req-707eee87-4ad0-4015-ad6f-08dd23468fc1'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:24.749070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2673a5e8e2774b258288b2942873893d', 'request_id': 'req-707eee87-4ad0-4015-ad6f-08dd23468fc1'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:24.755980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2673a5e8e2774b258288b2942873893d', 'request_id': 'req-707eee87-4ad0-4015-ad6f-08dd23468fc1'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:24.770964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] The token cache is being invalidate because project 2673a5e8e2774b258288b2942873893d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:24.771253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:24.771914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-707eee87-4ad0-4015-ad6f-08dd23468fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:24.773534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1126/2213] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:24 2022] DELETE /identity/v3/projects/2673a5e8e2774b258288b2942873893d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:24.780931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:24.780931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:24.780931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:24.793958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:24.806362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:24.809074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:25.104647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1088/2214] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:25.114417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.114985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.115182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.144656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:25.146000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:25.158399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1127/2215] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:25.162776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.178423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c64d0-1e79-45bf-8761-54969991bf9c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.183971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.184590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.184877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.185160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.185842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:25.186176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.187912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.211086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1089/2216] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:55:25.215531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.224961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784fb26-06f4-43c2-a9e2-a64ca7d9d5d9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.231019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.231709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.232050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.232326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.233114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.235186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.291191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.298319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1128/2217] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:25 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:25.302589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ba08a-1296-42d0-bac3-a917af372bf1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.416834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.417468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.417747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.418051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.418889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.424929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.484367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.492501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1090/2218] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:25 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:25.504543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67e261-e1a8-40b1-8498-d894e67637d6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.509722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.510950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.511496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.511767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.513452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.515319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.542271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.543266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1129/2219] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:25.561921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fdf1f-e01d-4c3e-974e-f6a2b71b1355 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.577222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.578041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.578323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.578597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.579346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.580990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2d000-779d-4729-8cce-e20366d2840a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.613266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1091/2220] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:25 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:25.617707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.641440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a237d60-f2dd-4d9a-9357-94d80b14dd36 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.646382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.647058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.647411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.647704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] PATH_INFO: `/v3/projects/935cfbc60a9344109e4e1fe8fcb63325/users/6138affd736942ea89c8f55817aabcee/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.666674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=935cfbc60a9344109e4e1fe8fcb63325, user_id=6138affd736942ea89c8f55817aabcee, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.669839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:25.702759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1130/2221] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:25 2022] PUT /identity/v3/projects/935cfbc60a9344109e4e1fe8fcb63325/users/6138affd736942ea89c8f55817aabcee/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:25.706129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba07b-b728-43ba-9896-e3001667a496 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.707031 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba07b-b728-43ba-9896-e3001667a496 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.707526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ba07b-b728-43ba-9896-e3001667a496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.760905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c50ba07b-b728-43ba-9896-e3001667a496 None None] MFA Rules not processed for user `6138affd736942ea89c8f55817aabcee`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:25.763511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c50ba07b-b728-43ba-9896-e3001667a496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:25.853538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:25.863956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1092/2222] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:25.875645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:25.877397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:25.955695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807e20e-5c61-4afa-b838-119023de7df7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:25.960308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:25.960766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:25.961092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:25.961370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:25.981845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:25.986472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:26.007183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1131/2223] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:33.504057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e065-fcc3-4b1b-9a0e-f8bb24719c56 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:33.505008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e065-fcc3-4b1b-9a0e-f8bb24719c56 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:33.506457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e065-fcc3-4b1b-9a0e-f8bb24719c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:33.536022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d547e065-fcc3-4b1b-9a0e-f8bb24719c56 None None] MFA Rules not processed for user `6d6e0871c846405fa60b355a987f9b2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:33.537500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d547e065-fcc3-4b1b-9a0e-f8bb24719c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:33.621730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1093/2224] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:34.105208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:34.107460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:34.119580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:34.277280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7f6258-2dd2-4d77-af67-313cba2d147d service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:34.288156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:34.288899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:34.289186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:34.289421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] PATH_INFO: `/v3/users/38ccfbcfcd474ed8b57a84f68d3bbed8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:34.291561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] RBAC: Authorizing `identity:delete_user(user_id=38ccfbcfcd474ed8b57a84f68d3bbed8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:34.293911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:34.419226 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38ccfbcfcd474ed8b57a84f68d3bbed8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:34.428230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38ccfbcfcd474ed8b57a84f68d3bbed8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:34.429085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38ccfbcfcd474ed8b57a84f68d3bbed8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:34.447612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38ccfbcfcd474ed8b57a84f68d3bbed8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:34.456337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38ccfbcfcd474ed8b57a84f68d3bbed8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:34.469098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1132/2225] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:34 2022] DELETE /identity/v3/users/38ccfbcfcd474ed8b57a84f68d3bbed8 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:34.473606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d0d4-8bc1-4499-b416-0559681a2c04 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:34.474167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d0d4-8bc1-4499-b416-0559681a2c04 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:34.474481 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15d0d4-8bc1-4499-b416-0559681a2c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:34.505830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3d15d0d4-8bc1-4499-b416-0559681a2c04 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:34.508320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3d15d0d4-8bc1-4499-b416-0559681a2c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:34.642648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1094/2226] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:34.653334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:34.654857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:34.796751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f2e20-9561-467b-8da1-980e9287211e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:34.804196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:34.807725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:34.808277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:34.808808 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:34.845202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:34.850990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:34.874000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1133/2227] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:35.217131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad054ab-92c2-4839-a2c1-83228c97e31c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:35.217638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad054ab-92c2-4839-a2c1-83228c97e31c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:35.217998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad054ab-92c2-4839-a2c1-83228c97e31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:35.249061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-cad054ab-92c2-4839-a2c1-83228c97e31c None None] MFA Rules not processed for user `dafa7108bd954266a90728b62ad68a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:35.250608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cad054ab-92c2-4839-a2c1-83228c97e31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:35.324614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1095/2228] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:35.702651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:35.711899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:35.736702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7586886-b618-4d29-8c90-10b24bedf228 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:35.742012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:35.742883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:35.743316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:35.743739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] PATH_INFO: `/v3/projects/eb92b5aeab15467b861b1e4c34b1e109` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:35.745107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb92b5aeab15467b861b1e4c34b1e109)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:35.748054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:35.783296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:35.815086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb92b5aeab15467b861b1e4c34b1e109', 'request_id': 'req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:35.824605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb92b5aeab15467b861b1e4c34b1e109', 'request_id': 'req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:35.832422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb92b5aeab15467b861b1e4c34b1e109', 'request_id': 'req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:35.846770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] The token cache is being invalidate because project eb92b5aeab15467b861b1e4c34b1e109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:35.847064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:35.847772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-21d719b3-a773-4d7f-9f28-c2f7d9c7c563 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:35.850048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1134/2229] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:35 2022] DELETE /identity/v3/projects/eb92b5aeab15467b861b1e4c34b1e109 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:35.855848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:35.856311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:35.856311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:35.879700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:35.881069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:35.937153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:35.958010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1096/2230] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:35.963756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:35.964238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:35.964662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:35.993004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:35.996371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:36.008511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1135/2231] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:36.010244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.020241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b640e-6201-4ad2-8c53-ed5183df001d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.026314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.027630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.027630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.027874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.028530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:36.030619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.032701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.049285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1097/2232] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:55:36.056071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.069492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e6f64-3788-457d-b845-aad0bb530511 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.082923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.083731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.084015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.084345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.085291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.087295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.137425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1136/2233] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:36.141743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.156731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7212ed-4a0e-4d74-bd9c-ca3baa16dfc0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.303736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.305332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.307902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.308242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.309703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.314785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.399169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1098/2234] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:36.404056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.420201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f4c59-a17c-46dd-bfa1-98dacbf9c753 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.441542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.442886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.443235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.444003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.444771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.447275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.466593 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.474705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1137/2235] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:36.479901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4cf2c8-89c5-4f03-aff5-2accaef773ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.488296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.501304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.502442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.503801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.505735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.510883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.530145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.532394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:36.538423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1099/2236] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:36.545604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.555680 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb677a6-4ae7-40a4-add2-9e4a5c948888 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.562841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.563544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3773c0-87f5-481f-8dc1-a733671f1c96 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:36.563790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.564220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.564600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] PATH_INFO: `/v3/users/41c76612734f419c9000da2e3b9774b8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.565861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41c76612734f419c9000da2e3b9774b8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.568404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.570532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:36.571463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.572264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.572666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] PATH_INFO: `/v3/projects/32d1b685ee624db79e1781c1c52adc14/users/b7796ede1e65464da1d2bf05803f1bc6/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.593139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] RBAC: Authorizing `identity:create_grant(project_id=32d1b685ee624db79e1781c1c52adc14, user_id=b7796ede1e65464da1d2bf05803f1bc6, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:36.597135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6d04-ff54-4ddb-900f-5fe11641e14e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:36.616515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1100/2237] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:36 2022] PUT /identity/v3/projects/32d1b685ee624db79e1781c1c52adc14/users/b7796ede1e65464da1d2bf05803f1bc6/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:36.629794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6a6d-6302-471f-84ef-e4535099fbbf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.630267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6a6d-6302-471f-84ef-e4535099fbbf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.630669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a6a6d-6302-471f-84ef-e4535099fbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.690550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-689a6a6d-6302-471f-84ef-e4535099fbbf None None] MFA Rules not processed for user `b7796ede1e65464da1d2bf05803f1bc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:36.691249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41c76612734f419c9000da2e3b9774b8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:36.692043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-689a6a6d-6302-471f-84ef-e4535099fbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:36.717085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41c76612734f419c9000da2e3b9774b8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:36.717791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41c76612734f419c9000da2e3b9774b8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:36.744434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41c76612734f419c9000da2e3b9774b8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:36.762767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfcb1b3a-22f9-453d-9f17-8ab52e71fd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41c76612734f419c9000da2e3b9774b8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:36.782371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1138/2238] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:36 2022] DELETE /identity/v3/users/41c76612734f419c9000da2e3b9774b8 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:55:36.787189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.787734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.788524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.846972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:36.848437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:36.855322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1101/2239] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:36.860172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:36.860841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:36.860841 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:36.894678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:36.923526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:36.950741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=81,keystone:DELETE=16,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:36.968933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:36.973672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1139/2240] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:36.974991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:36.976453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:37.056193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1102/2241] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:37.057259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.059442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:37.105715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889011c-4541-4249-af25-47863b19e7b0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.112494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.113940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.114309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.114601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.115266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.121836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.159909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1140/2242] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:36 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:37.164797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.166598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:37.172377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e52ad-718a-4a42-b7ff-04879bc6d258 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.237919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab39c7-8311-4b4a-ab8a-0916ebf9cd44 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.242809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.243437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.243786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.244146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.245842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.246716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.247205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.247625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.326416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.328671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.338588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1103/2243] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:55:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:37.339514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.348235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.350566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.353582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9f956-131a-417f-ad8e-37bfac0dc720 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.359731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.360451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.360826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.361193 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.361967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.363979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.365562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1141/2244] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:37.373346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:37.395905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1104/2245] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:37 2022] POST /identity/v3/users => generated 289 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:37.396531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.430332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2bc8d4-ad04-4215-a5af-4408913153c6 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.446479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.447155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.448021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.448021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.448349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.449986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.519727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1142/2246] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:37.526855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.573060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ff03-f0fc-4ead-b8fe-377130791ee6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.631961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.638477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.640255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.642736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.643495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.650634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb28139-d58f-4b08-a36f-5e714c484208 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.705726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1105/2247] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:37 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:37.710269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:37.726691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d14a8a-3b07-4a54-958e-6bcc6e86bf4b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:37.748947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:37.749997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.754345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.755388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] PATH_INFO: `/v3/projects/2ca9bd3c385c48ed9ea47cf8ac705553/users/44d3eaaeca514845bd48a397f0c600c5/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.808822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:37.838905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ca9bd3c385c48ed9ea47cf8ac705553, user_id=44d3eaaeca514845bd48a397f0c600c5, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:37.842085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:37.877508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1143/2248] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:37 2022] PUT /identity/v3/projects/2ca9bd3c385c48ed9ea47cf8ac705553/users/44d3eaaeca514845bd48a397f0c600c5/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:37.889009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:37.890020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:37.891224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:37.993148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] MFA Rules not processed for user `44d3eaaeca514845bd48a397f0c600c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:37.994493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:38.065334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.067389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:38.166226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1106/2249] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:38.167410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.174944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d47df-b814-426f-b2db-8a77f1908ac8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.186300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.186300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.186300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.186300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] PATH_INFO: `/v3/projects/67727678d86647b6a2162506b972510f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.186725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] RBAC: Authorizing `identity:delete_project(project_id=67727678d86647b6a2162506b972510f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.187690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.193293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df5e3e-0534-49b7-aa61-6538262a3c6d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.205071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.205961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.206267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.206530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.207208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.211485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.282171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67727678d86647b6a2162506b972510f', 'request_id': 'req-7c105fa6-ef1d-4cb9-8704-485b961c5fca'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:38.296758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1107/2250] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:38 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:38.301084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.302152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67727678d86647b6a2162506b972510f', 'request_id': 'req-7c105fa6-ef1d-4cb9-8704-485b961c5fca'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:38.313364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67727678d86647b6a2162506b972510f', 'request_id': 'req-7c105fa6-ef1d-4cb9-8704-485b961c5fca'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:38.336251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] The token cache is being invalidate because project 67727678d86647b6a2162506b972510f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:38.336981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:38.338339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c105fa6-ef1d-4cb9-8704-485b961c5fca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:38.342937 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1144/2251] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:38 2022] DELETE /identity/v3/projects/67727678d86647b6a2162506b972510f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:38.347951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f0465-84bf-42f2-9924-9eb702b63cc6 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.348403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f0465-84bf-42f2-9924-9eb702b63cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.351194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627f0465-84bf-42f2-9924-9eb702b63cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.411420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-627f0465-84bf-42f2-9924-9eb702b63cc6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:38.413064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-627f0465-84bf-42f2-9924-9eb702b63cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:38.462217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82788291-8514-4557-901a-583bdbd57038 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.479261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.480038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.480434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.482608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.483373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.494441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.560038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1145/2252] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:38.568130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.568475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.569454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.582907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1108/2253] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:38 2022] POST /identity/v3/users => generated 295 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:38.586647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.590483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:38.621019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:38.622823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:38.624281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8b61-09f1-4f56-b737-682d3a6b36bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.633568 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1146/2254] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:38.638338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.646541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.647182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.647465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.647737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.648391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.650569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.682526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4778c3b0-a8b9-4cba-bc31-a4109571d344 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.687925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1109/2255] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:38.697574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.706325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.707761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.708646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.709402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.710676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:38.711779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.717269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.726062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c514e659-657a-4faa-9244-575b31722090 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.733465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:38.741163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1147/2256] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:55:38.742969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.745415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.747197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.748575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.749403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] PATH_INFO: `/v3/projects/40210720f602439497c404612216b268/users/d9798cac05cc4757acb2a638efeb504a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.765184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1fd55-060d-4ebf-be02-3e1eca866f93 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:38.770533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:38.772742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:38.773214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:38.773944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:38.776393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.778271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40210720f602439497c404612216b268, user_id=d9798cac05cc4757acb2a638efeb504a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:38.779482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.785334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:38.808680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:38.816316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1110/2257] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:38 2022] PUT /identity/v3/projects/40210720f602439497c404612216b268/users/d9798cac05cc4757acb2a638efeb504a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:38.826990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.881719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1148/2258] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:38 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:38.883078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:38.902725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.031595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7a707-33d6-410c-b342-a92a30ca3255 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.100218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10691ab3-5e86-4c4f-91c5-dc155e2adec0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.114140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.114272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.114444 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.114722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] PATH_INFO: `/v3/users/6138affd736942ea89c8f55817aabcee` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.118043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] RBAC: Authorizing `identity:delete_user(user_id=6138affd736942ea89c8f55817aabcee)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.120931 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.211277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6138affd736942ea89c8f55817aabcee'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:39.212166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.213271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.218866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.219168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.222207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.226706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.230852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6138affd736942ea89c8f55817aabcee'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:39.232361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6138affd736942ea89c8f55817aabcee'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:39.279317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1111/2259] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:39.280383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.287760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.309579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6138affd736942ea89c8f55817aabcee'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:39.330570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302338df-5c7f-42c7-9355-7ace0cecfa72 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.344881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6138affd736942ea89c8f55817aabcee'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:39.346949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.347591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.350115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.350426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.354160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.356520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea47f55-c94f-4285-8b4f-a3694a985f9e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.357589 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1149/2260] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:38 2022] DELETE /identity/v3/users/6138affd736942ea89c8f55817aabcee => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:39.358706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.362277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.425844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1112/2261] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:39 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:39.425844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.428422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.428577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.501158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:39.502705 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.514394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:39.520605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed15a2-8ca5-4996-9bb7-104a83432eed admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.531638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.532607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.533968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.534392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] PATH_INFO: `/v3/projects/40210720f602439497c404612216b268/users/d9798cac05cc4757acb2a638efeb504a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.539031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40210720f602439497c404612216b268, user_id=d9798cac05cc4757acb2a638efeb504a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.546176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.546731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1113/2262] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:39.552843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.578070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1150/2263] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:39 2022] PUT /identity/v3/projects/40210720f602439497c404612216b268/users/d9798cac05cc4757acb2a638efeb504a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:39.583227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.590549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.594191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa6ed6-3944-442f-b58a-c7ae4567a732 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.722149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1063e48a-c933-4429-8e8e-c546e51dd810 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.736198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.737524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.738037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.738460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.799678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.800296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.800587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.800867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.801524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.803176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec5a9c2-ed5d-42b8-9628-78dbb68e8e90 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.832464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1114/2264] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:39.836871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.837918 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.838356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.893500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.894988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.902937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] MFA Rules not processed for user `d9798cac05cc4757acb2a638efeb504a`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:39.904352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:39.911084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:39.915390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1151/2265] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:39.917933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.929056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0492c-b955-41a9-a303-f6a1f463d7eb service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.934566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.935233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.935518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.936363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:39.937020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:39.938905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:39.954179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1152/2266] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:39.955324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:39.970588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4499f-c88b-437c-aa87-a7b6850ab6e8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:39.975934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:39.976756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:39.977047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:39.977344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] PATH_INFO: `/v3/projects/c4ddd386516544bdb6ceb9446cf5d3f7/users/b9cbe245a59b453285212d48bc192a31/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:40.005472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ddd386516544bdb6ceb9446cf5d3f7, user_id=b9cbe245a59b453285212d48bc192a31, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:40.010579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dd009-a9e7-4f41-8e16-b04057df9d3b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:40.051762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1153/2267] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:39 2022] PUT /identity/v3/projects/c4ddd386516544bdb6ceb9446cf5d3f7/users/b9cbe245a59b453285212d48bc192a31/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:40.064915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:40.065350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:40.065741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:40.106025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1115/2268] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:40.113121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] MFA Rules not processed for user `b9cbe245a59b453285212d48bc192a31`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:40.114175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:40.124548 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:40.126146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:40.290252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143da14-0e2d-4175-a8c0-3c1aebba8bff None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:40.310242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:40.355886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1154/2269] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:40.461047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:40.463852 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:40.608061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:40.608832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:40.609213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:40.609597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:40.617487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:40.655592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd0a8c-4e37-4830-82c7-02f23c18088e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:40.667898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:40.668551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:40.668841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:40.669121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:40.695522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:40.697610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:40.716736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1155/2270] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:40 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:40.718140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:40.719794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:40.896893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:40.898791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:40.932218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853bd94-7670-4ae4-83e9-724e1b5d711f service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:40.944697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:40.946618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:40.947167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1116/2271] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 823 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:40.947927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:40.949000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] PATH_INFO: `/v3/projects/935cfbc60a9344109e4e1fe8fcb63325` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:40.951206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=935cfbc60a9344109e4e1fe8fcb63325)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:40.954386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:41.193468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935cfbc60a9344109e4e1fe8fcb63325', 'request_id': 'req-402eee93-b596-4724-8239-535a7eaba3d0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:41.205934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935cfbc60a9344109e4e1fe8fcb63325', 'request_id': 'req-402eee93-b596-4724-8239-535a7eaba3d0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:41.223661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935cfbc60a9344109e4e1fe8fcb63325', 'request_id': 'req-402eee93-b596-4724-8239-535a7eaba3d0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:41.252149 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] The token cache is being invalidate because project 935cfbc60a9344109e4e1fe8fcb63325 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:41.252484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:41.254247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:41.275638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1156/2272] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:40 2022] DELETE /identity/v3/projects/935cfbc60a9344109e4e1fe8fcb63325 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:43.037321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:43.049360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a69a49-f968-4416-9d32-5f4cf9e18481 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:43.059387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:43.155072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:43.155976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:43.156409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:43.157062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:43.159711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:43.233461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:43.234897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:43.246413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1117/2273] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:44.142876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:44.144497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:44.160601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402eee93-b596-4724-8239-535a7eaba3d0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:44.164690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:44.165410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:44.165755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:44.166261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:44.168365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:44.202558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:44.292274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:44.293744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c59f802-2d26-4ef2-9894-6013669ebaf6 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:44.334359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1157/2274] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:48.898460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:48.899961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:48.965626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fb07fe-cd8f-42ab-99df-6257aa20711d service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:48.970270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:48.970898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:48.971179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:48.971450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] PATH_INFO: `/v3/users/b7796ede1e65464da1d2bf05803f1bc6` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:48.972579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7796ede1e65464da1d2bf05803f1bc6)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:48.974532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:49.024167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7796ede1e65464da1d2bf05803f1bc6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.032336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7796ede1e65464da1d2bf05803f1bc6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.045373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:49.048112 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7796ede1e65464da1d2bf05803f1bc6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.049164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7796ede1e65464da1d2bf05803f1bc6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.059169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7796ede1e65464da1d2bf05803f1bc6'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.065209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1118/2275] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:48 2022] DELETE /identity/v3/users/b7796ede1e65464da1d2bf05803f1bc6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:49.069969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:49.070508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:49.070948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:49.092677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:49.093821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:49.168495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1158/2276] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:55:49.178246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:49.179651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:49.239617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9192f39-5df7-4ac0-99fe-3551c8314182 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:49.244492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:49.245320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:49.245733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:49.246044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:49.255645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:49.257113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:49.267653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1119/2277] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:49.684220 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:49.685711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:49.707159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5f82-8282-4a6b-9559-e3ab09f7f4f8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:49.719134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:49.719765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:49.720510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:49.720510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] PATH_INFO: `/v3/projects/32d1b685ee624db79e1781c1c52adc14` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:49.727388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32d1b685ee624db79e1781c1c52adc14)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:49.730047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:49.825549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32d1b685ee624db79e1781c1c52adc14', 'request_id': 'req-592c7b0c-3cb8-4009-98e8-09d47424a25b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.842141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32d1b685ee624db79e1781c1c52adc14', 'request_id': 'req-592c7b0c-3cb8-4009-98e8-09d47424a25b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.851469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32d1b685ee624db79e1781c1c52adc14', 'request_id': 'req-592c7b0c-3cb8-4009-98e8-09d47424a25b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.866139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] The token cache is being invalidate because project 32d1b685ee624db79e1781c1c52adc14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:49.867522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.868595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:49.871960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1159/2278] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:49 2022] DELETE /identity/v3/projects/32d1b685ee624db79e1781c1c52adc14 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:49.875689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:49.890121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f36921-00d3-4d82-8a71-1fc83aae5684 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:49.968794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:49.969524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:49.969720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:49.970108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] PATH_INFO: `/v3/users/44d3eaaeca514845bd48a397f0c600c5` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:49.971265 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d3eaaeca514845bd48a397f0c600c5)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:49.973234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:50.027726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d3eaaeca514845bd48a397f0c600c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.037226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d3eaaeca514845bd48a397f0c600c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.053846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d3eaaeca514845bd48a397f0c600c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.054654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d3eaaeca514845bd48a397f0c600c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.063648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d3eaaeca514845bd48a397f0c600c5'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.074311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1120/2279] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:49 2022] DELETE /identity/v3/users/44d3eaaeca514845bd48a397f0c600c5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:50.363218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:50.364829 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:50.379932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592c7b0c-3cb8-4009-98e8-09d47424a25b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:50.446158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:50.463281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:50.463930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:50.464217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:50.464494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] PATH_INFO: `/v3/projects/2ca9bd3c385c48ed9ea47cf8ac705553` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:50.465674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ca9bd3c385c48ed9ea47cf8ac705553)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:50.467696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:50.527967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ca9bd3c385c48ed9ea47cf8ac705553', 'request_id': 'req-94db1601-1af1-479a-8589-7cffd65859e3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.537071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ca9bd3c385c48ed9ea47cf8ac705553', 'request_id': 'req-94db1601-1af1-479a-8589-7cffd65859e3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.544517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ca9bd3c385c48ed9ea47cf8ac705553', 'request_id': 'req-94db1601-1af1-479a-8589-7cffd65859e3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.557398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] The token cache is being invalidate because project 2ca9bd3c385c48ed9ea47cf8ac705553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:50.557766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.558429 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.560232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1160/2280] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:50 2022] DELETE /identity/v3/projects/2ca9bd3c385c48ed9ea47cf8ac705553 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:50.564343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:50.565904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:50.581062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749629b-f6e0-4420-8963-1580dba0e523 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:50.585247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:50.652184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:50.653486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:50.653486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:50.653700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] PATH_INFO: `/v3/users/d9798cac05cc4757acb2a638efeb504a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:50.654950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9798cac05cc4757acb2a638efeb504a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:50.657084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:50.722013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9798cac05cc4757acb2a638efeb504a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.730323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9798cac05cc4757acb2a638efeb504a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.742830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9798cac05cc4757acb2a638efeb504a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.743557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9798cac05cc4757acb2a638efeb504a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.752428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1b7e53ea-0649-43ab-8c52-affda1a2186a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9798cac05cc4757acb2a638efeb504a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:50.764460 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1121/2281] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:50 2022] DELETE /identity/v3/users/d9798cac05cc4757acb2a638efeb504a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:51.106572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.109002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:51.133746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db1601-1af1-479a-8589-7cffd65859e3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.219861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.220505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.220784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.221058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] PATH_INFO: `/v3/projects/40210720f602439497c404612216b268` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.222235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] RBAC: Authorizing `identity:delete_project(project_id=40210720f602439497c404612216b268)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.224199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.292269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40210720f602439497c404612216b268', 'request_id': 'req-7c491432-bba0-4b61-b8e5-f7889a76919f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:51.314347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40210720f602439497c404612216b268', 'request_id': 'req-7c491432-bba0-4b61-b8e5-f7889a76919f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:51.319860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40210720f602439497c404612216b268', 'request_id': 'req-7c491432-bba0-4b61-b8e5-f7889a76919f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:51.333148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] The token cache is being invalidate because project 40210720f602439497c404612216b268 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:51.333442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:51.334831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7c491432-bba0-4b61-b8e5-f7889a76919f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:51.335888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1161/2282] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:51 2022] DELETE /identity/v3/projects/40210720f602439497c404612216b268 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:51.341669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344893-6067-436d-9908-73388f93bb5c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.342202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344893-6067-436d-9908-73388f93bb5c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.342659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43344893-6067-436d-9908-73388f93bb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.366494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-43344893-6067-436d-9908-73388f93bb5c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:51.367765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43344893-6067-436d-9908-73388f93bb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:51.426615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1122/2283] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:51.434895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.435399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.435495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.450635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:51.457128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:51.459049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:51.467932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1162/2284] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:51.473005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344893-6067-436d-9908-73388f93bb5c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.485151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43344893-6067-436d-9908-73388f93bb5c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.491171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.491949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.492304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.492686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.494096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:51.494474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.496303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.511506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1123/2285] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:55:51.516419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.541337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bcb1a-27af-4bd3-9974-b7260a56af26 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.552250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.553107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.553418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.553693 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.554413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.557859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.588767 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1163/2286] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:51 2022] POST /identity/v3/projects => generated 385 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:51.593156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.604967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024bacc-444b-4f6c-8f3e-41885629002b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.614557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:51.677355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.678050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.678401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.678743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.679729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.681673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.717891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1124/2287] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:51 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:55:51.723020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.734904 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a351866-4189-4f81-837d-e27bb6da6146 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.740510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.741187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.742445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.742445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.742659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.744300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.755473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1164/2288] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:51.759901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.770783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2480004-0fae-409d-b9d3-af000e30af79 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.776146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.776742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.777020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.777290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.777984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.779586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0a157-02f5-412f-85f3-5c4617bde973 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.790289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1125/2289] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:51.794777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.804705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb3a2f-9142-4e1c-b122-43969ca747ca admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:51.809895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:51.810550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.810830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.811104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] PATH_INFO: `/v3/projects/ae57105c22764eb4928417230b895753/users/45497858f21847cca4fffb6a769cbf00/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.826864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae57105c22764eb4928417230b895753, user_id=45497858f21847cca4fffb6a769cbf00, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:51.829671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:51.843616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1165/2290] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:51 2022] PUT /identity/v3/projects/ae57105c22764eb4928417230b895753/users/45497858f21847cca4fffb6a769cbf00/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:51.854666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:51.855200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:51.855544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:51.886207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] MFA Rules not processed for user `45497858f21847cca4fffb6a769cbf00`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:51.887436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:51.954105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1126/2291] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:51.966647 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.968480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:51.974321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:51.975668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:52.037971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696f0ac-e672-4400-911a-e63449a2e3f6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:52.042779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:52.044031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:52.044822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:52.044822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:52.051695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f87b8-fee1-4459-a3be-e95d5e98d405 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:52.054397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:52.056464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7939c0-335d-42fc-89ab-694081757efa service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:52.057394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:52.058078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:52.058368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:52.058763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] PATH_INFO: `/v3/users/b9cbe245a59b453285212d48bc192a31` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:52.059916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9cbe245a59b453285212d48bc192a31)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:52.062175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:52.066877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1166/2292] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:52.088642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:52.118786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9cbe245a59b453285212d48bc192a31'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.128670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9cbe245a59b453285212d48bc192a31'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.151150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9cbe245a59b453285212d48bc192a31'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.153262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9cbe245a59b453285212d48bc192a31'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.163588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9cbe245a59b453285212d48bc192a31'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.195553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1127/2293] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:51 2022] DELETE /identity/v3/users/b9cbe245a59b453285212d48bc192a31 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:52.198482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:52.198927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:52.199108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:52.253477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:52.254736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:52.351566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1167/2294] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:52.359818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:52.361362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:52.455798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f260c65-b0bc-4684-8d9e-8f32b6c575fb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:52.459660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:52.460504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:52.460900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:52.461270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:52.472768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:52.474771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:52.487152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1128/2295] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:52.844300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:52.845815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:52.858287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b7d303-618e-4590-a037-5e97d3a43b26 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:52.863657 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:52.864373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:52.864903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:52.865393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] PATH_INFO: `/v3/projects/c4ddd386516544bdb6ceb9446cf5d3f7` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:52.866661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ddd386516544bdb6ceb9446cf5d3f7)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:52.869284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:52.911772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:52.920875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ddd386516544bdb6ceb9446cf5d3f7', 'request_id': 'req-a2c505fd-a0fb-4376-8652-714971c1e9e2'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.929210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ddd386516544bdb6ceb9446cf5d3f7', 'request_id': 'req-a2c505fd-a0fb-4376-8652-714971c1e9e2'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.935460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ddd386516544bdb6ceb9446cf5d3f7', 'request_id': 'req-a2c505fd-a0fb-4376-8652-714971c1e9e2'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.947063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] The token cache is being invalidate because project c4ddd386516544bdb6ceb9446cf5d3f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:52.947362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.948006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a2c505fd-a0fb-4376-8652-714971c1e9e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:52.949489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1168/2296] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:52 2022] DELETE /identity/v3/projects/c4ddd386516544bdb6ceb9446cf5d3f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:54.865037 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:54.866497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:54.879084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e5541-8e58-46a9-ab40-d5150b254765 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:54.936863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:54.937496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:54.937780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:54.938083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] PATH_INFO: `/v3/users/45497858f21847cca4fffb6a769cbf00` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:54.939209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45497858f21847cca4fffb6a769cbf00)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:54.941142 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:54.986956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:54.988898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45497858f21847cca4fffb6a769cbf00'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:54.998342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45497858f21847cca4fffb6a769cbf00'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.010818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45497858f21847cca4fffb6a769cbf00'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.011807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45497858f21847cca4fffb6a769cbf00'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.019587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45497858f21847cca4fffb6a769cbf00'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.026018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1129/2297] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:55:54 2022] DELETE /identity/v3/users/45497858f21847cca4fffb6a769cbf00 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:55.030494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.030981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.031074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.051629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:55.052821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:55.111703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1169/2298] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:55.121123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.125001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:55.188375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4c69-d484-4a7d-abb2-57c0ca9200b8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:55.192028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:55.192638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.192921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.193196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.203867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:55.205307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0af9341-c924-4ab2-862f-477f95182011 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:55.217561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1130/2299] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:55.574655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.576108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:55.588776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ac9c8-1dd1-49c1-9a9d-664e1bb1a07c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:55.593399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:55.594487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.594487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.594724 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] PATH_INFO: `/v3/projects/ae57105c22764eb4928417230b895753` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.595737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae57105c22764eb4928417230b895753)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:55.597646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:55.644179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae57105c22764eb4928417230b895753', 'request_id': 'req-e75484f4-8a31-4e75-babb-b354ab7d09af'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.651849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae57105c22764eb4928417230b895753', 'request_id': 'req-e75484f4-8a31-4e75-babb-b354ab7d09af'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.657528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae57105c22764eb4928417230b895753', 'request_id': 'req-e75484f4-8a31-4e75-babb-b354ab7d09af'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.669019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] The token cache is being invalidate because project ae57105c22764eb4928417230b895753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:55:55.669309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.669987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e75484f4-8a31-4e75-babb-b354ab7d09af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:55:55.671466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1170/2300] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:55:55 2022] DELETE /identity/v3/projects/ae57105c22764eb4928417230b895753 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:55.676382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.676668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.676943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.696286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:55.697562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:55.756580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1131/2301] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:55.764659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.765010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.765352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.785781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:55.787100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:55.795733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1171/2302] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:55.800237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.810544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23d9f00-2469-477f-aae0-159c803d56fa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:55.815241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:55.815849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.816126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.816395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.817038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:55:55.817339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:55.819109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:55.831238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1132/2303] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:55:55.835682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.845341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79c439-fa76-4cc7-bdc7-0c4a2d9487d3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:55.850259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:55.850940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.851304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.851648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.852418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:55.856351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:55.885498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1172/2304] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:55:55 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:55:55.889824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.900684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5f97f-60c3-4f4f-be37-a1e87f86b4f8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:55.949083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:55.959078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:55.959699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:55.960160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:55.960445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:55.961108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:55.963805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:55.987724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1133/2305] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:55:55 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:55:55.988899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:55.999389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142f88a9-c742-4f82-9a2e-cc93f507463c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:56.004122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:56.004745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:56.005021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:56.005291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:56.005977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:56.007575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:56.018609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1173/2306] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:55:56.022398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:56.033182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2185cc69-8299-4fd2-80fd-616f7e6c1db8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:56.038363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:56.038882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:56.039168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:56.039519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:56.040230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:56.041830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be73dcd6-4df6-45a8-a8f1-1e24f92214d7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:56.053715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1134/2307] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:55:56.072663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:56.083207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18456-1586-468c-88a8-6e1d91f8f5ce admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:56.088738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:56.089403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:56.089689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:56.090107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] PATH_INFO: `/v3/projects/e96fd42da1454b538023fc3e75f7e03c/users/1d481efe927b4994b36fe8fd2dba6fbf/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:56.101672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:56.106422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e96fd42da1454b538023fc3e75f7e03c, user_id=1d481efe927b4994b36fe8fd2dba6fbf, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:56.109499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:56.125023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1174/2308] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:55:56 2022] PUT /identity/v3/projects/e96fd42da1454b538023fc3e75f7e03c/users/1d481efe927b4994b36fe8fd2dba6fbf/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:55:56.135756 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a223-3de1-4b65-9d32-023d34c0e2a0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:56.136373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a223-3de1-4b65-9d32-023d34c0e2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:56.136729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5140a223-3de1-4b65-9d32-023d34c0e2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:56.171781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5140a223-3de1-4b65-9d32-023d34c0e2a0 None None] MFA Rules not processed for user `1d481efe927b4994b36fe8fd2dba6fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:56.173103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5140a223-3de1-4b65-9d32-023d34c0e2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:56.247833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1135/2309] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:55:56.260061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:55:56.262652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:56.322008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2cf7b-10e4-4a10-95e8-658e5fba4335 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:55:56.325609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:55:56.326251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:56.326533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:56.326811 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:56.336242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:55:56.338998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3684b359-b9bc-4827-b81c-794e96214e89 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:55:56.348836 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1175/2310] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:55:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:55:57.736151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:55:57.736704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:55:57.736704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:55:57.755967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] MFA Rules not processed for user `1d481efe927b4994b36fe8fd2dba6fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:55:57.757167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:55:57.764853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1136/2311] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:55:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:02.125326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a4f6-5c40-4f20-8084-265b554e2741 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:02.125849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a4f6-5c40-4f20-8084-265b554e2741 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:02.126128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44a4f6-5c40-4f20-8084-265b554e2741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:02.146222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6a44a4f6-5c40-4f20-8084-265b554e2741 None None] MFA Rules not processed for user `5cc7c221754b4488adff9b193e8e0eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:02.147442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6a44a4f6-5c40-4f20-8084-265b554e2741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:02.229421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1176/2312] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:56:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:07.750296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:08.527713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:08.529199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:08.597669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3b780d-0a07-46bd-8037-42e2941aaa5a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:08.603140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:08.603856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:08.604114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:08.604357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:08.606151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:08.680968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:08.682569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:08.694522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1137/2313] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:56:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:56:12.220027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:18.688822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=50 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:19.004598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e111d-6768-47ef-a88f-22cce6e78134 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:19.005120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e111d-6768-47ef-a88f-22cce6e78134 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:19.005275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e111d-6768-47ef-a88f-22cce6e78134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:19.025183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1e0e111d-6768-47ef-a88f-22cce6e78134 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:19.026668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1e0e111d-6768-47ef-a88f-22cce6e78134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:19.082166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1177/2314] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:56:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:19.094649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:19.096049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:19.165752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449689fa-c9c3-4be0-b5ef-68913844e10f service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:19.174912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:19.175587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:19.175864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:19.176157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:19.185176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:19.186811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:19.194979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1138/2315] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:19.735346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e884-16a5-4826-9665-c481955248b8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:19.735640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e884-16a5-4826-9665-c481955248b8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:19.735919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6e884-16a5-4826-9665-c481955248b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:19.755397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a7a6e884-16a5-4826-9665-c481955248b8 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:19.756604 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a7a6e884-16a5-4826-9665-c481955248b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:19.764373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1178/2316] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 01:56:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:19.777700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:19.788275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34e2ce-3cde-4c3c-9717-5176d1243097 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:19.793922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:19.794532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:19.794810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:19.795082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:19.804073 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:19.805738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:19.815064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1139/2317] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:56:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:20.064004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91652-0be1-455c-9b01-3bff011b636d None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:20.064526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91652-0be1-455c-9b01-3bff011b636d None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:20.064637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f91652-0be1-455c-9b01-3bff011b636d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:20.086490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-28f91652-0be1-455c-9b01-3bff011b636d None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:20.087725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-28f91652-0be1-455c-9b01-3bff011b636d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:20.095582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1179/2318] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:56:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:20.108410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:20.120499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853ae1a-e446-4dd1-a23c-f2738796baba service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:20.126375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:20.127093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:20.127646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:20.128136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:20.138007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:20.139907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:20.149889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1140/2319] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:20.515190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:20.515484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:20.515768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:20.539550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:20.540960 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:20.548757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1180/2320] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 01:56:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:20.564659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:20.575366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e35e17-95eb-4dfa-893a-ef1fbdfec063 service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:20.580567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:20.581186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:20.581469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:20.581992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:20.591498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:20.593178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64112f22-f58f-47c5-8310-d55dc4f0fa3a service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:20.603053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1141/2321] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:56:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:22.801591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:22.863018 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f02269-bfb4-4684-8c5b-63cc759a3065 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:22.868096 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:22.868723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:22.869116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:22.869399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] PATH_INFO: `/v3/users/1d481efe927b4994b36fe8fd2dba6fbf` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:22.870557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d481efe927b4994b36fe8fd2dba6fbf)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:22.872462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:22.917268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d481efe927b4994b36fe8fd2dba6fbf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:22.924306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d481efe927b4994b36fe8fd2dba6fbf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:22.924950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d481efe927b4994b36fe8fd2dba6fbf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:22.937132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d481efe927b4994b36fe8fd2dba6fbf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:22.943857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d481efe927b4994b36fe8fd2dba6fbf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:22.949581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1181/2322] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:56:22 2022] DELETE /identity/v3/users/1d481efe927b4994b36fe8fd2dba6fbf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:56:22.954024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:22.954499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:22.954604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:22.973273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:22.974442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:23.031695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1142/2323] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:56:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:23.042189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:23.044125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:23.051207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:23.103354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73817f-e041-469d-9a71-f2febb987b66 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:23.107023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:23.107626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:23.107903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:23.108173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:23.117462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:23.118899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda7454-4f95-4237-b33a-78e29feea47e service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:23.128463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1182/2324] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:56:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:56:23.300754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:23.302245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:23.314093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b76c52d-4388-469d-a898-ad7c7e55e262 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:23.318829 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:23.319462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:23.319744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:23.320023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] PATH_INFO: `/v3/projects/e96fd42da1454b538023fc3e75f7e03c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:23.321151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e96fd42da1454b538023fc3e75f7e03c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:23.323260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:23.367880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:23.371165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e96fd42da1454b538023fc3e75f7e03c', 'request_id': 'req-c3531d93-18fa-4d86-bc9a-1d79878548c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:23.378819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e96fd42da1454b538023fc3e75f7e03c', 'request_id': 'req-c3531d93-18fa-4d86-bc9a-1d79878548c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:23.384528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e96fd42da1454b538023fc3e75f7e03c', 'request_id': 'req-c3531d93-18fa-4d86-bc9a-1d79878548c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:23.395718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] The token cache is being invalidate because project e96fd42da1454b538023fc3e75f7e03c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:56:23.396004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:23.396627 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:56:23.398624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1143/2325] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:56:23 2022] DELETE /identity/v3/projects/e96fd42da1454b538023fc3e75f7e03c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:56:33.124097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=24 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:33.392738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:47.584985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:47.585495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:47.585603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:47.605987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:56:47.607208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:47.666011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1183/2326] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:56:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:56:47.687676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:47.689098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:47.761018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3531d93-18fa-4d86-bc9a-1d79878548c7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:47.766295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:47.766904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:47.767189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:47.767463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:47.776709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:47.778347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93989a-9193-4d8c-8c6f-e2a7fcadabf9 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:47.786894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1144/2327] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:56:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:51.997586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:56:51.999246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:52.093988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a547238-6e2a-45cb-b9bd-09efb68d9355 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:56:52.098950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:56:52.099575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:56:52.099866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:56:52.100142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:56:52.101890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:56:52.118539 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:56:52.120132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ee8ac-b803-4f3e-b0df-09f7b83e0a6c service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:56:52.133303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1184/2328] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:56:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:56:57.783216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=32 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:01.847629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:01.848322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:01.848322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:01.849531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1145/2329] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:57:01.855459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315046-43b2-479e-a9ae-162e973e3f89 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:01.856029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315046-43b2-479e-a9ae-162e973e3f89 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:01.856029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8315046-43b2-479e-a9ae-162e973e3f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:01.877012 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f8315046-43b2-479e-a9ae-162e973e3f89 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:01.878314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8315046-43b2-479e-a9ae-162e973e3f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:01.946275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1185/2330] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:57:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:57:01.959295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:57:01.961351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:02.037466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9ea19-15ea-43ec-b688-5c0efc09319b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:57:02.042127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:57:02.042879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.043085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.043370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.055964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:57:02.057710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bdb2b0-55d4-4e82-b583-b0d12679c7aa service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:57:02.071183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1146/2331] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:57:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:57:02.156670 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.156986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.157266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.158675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1186/2332] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:57:02.163877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087738-0f24-48b1-9140-fcd2f9589c84 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.164301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087738-0f24-48b1-9140-fcd2f9589c84 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.164673 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08087738-0f24-48b1-9140-fcd2f9589c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.185018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-08087738-0f24-48b1-9140-fcd2f9589c84 None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:02.186272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-08087738-0f24-48b1-9140-fcd2f9589c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:02.246545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1147/2333] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:57:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:57:02.258746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:57:02.264752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:02.279800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49317093-f031-4130-9fd2-2a5dadd1c394 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:57:02.284482 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:57:02.285169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.285525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.285906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.294179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:57:02.295633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05fda6-697d-498c-837c-2069c2a9d790 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:57:02.304626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1187/2334] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:57:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:57:02.431420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.431707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.431978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.433474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1148/2335] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:57:02.439325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172681-23d9-4d59-91f1-de0fea654967 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.439739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172681-23d9-4d59-91f1-de0fea654967 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.440080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46172681-23d9-4d59-91f1-de0fea654967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.460353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-46172681-23d9-4d59-91f1-de0fea654967 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:02.461543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-46172681-23d9-4d59-91f1-de0fea654967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:02.471159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1188/2336] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:57:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:57:02.482239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:57:02.483890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:02.496722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55247dcb-c287-4fe0-8851-66fe0a2bb25e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:57:02.500188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:57:02.500824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:02.501103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:02.501369 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:02.511445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:57:02.512859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:57:02.523790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1149/2337] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:57:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:57:06.150459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22ca1-7d40-422e-a62d-9274b4fc458a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:06.150961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22ca1-7d40-422e-a62d-9274b4fc458a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:06.151214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d22ca1-7d40-422e-a62d-9274b4fc458a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:06.165449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:06.171407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c9d22ca1-7d40-422e-a62d-9274b4fc458a None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:06.172618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c9d22ca1-7d40-422e-a62d-9274b4fc458a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:06.180446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1189/2338] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:57:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:57:06.192796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:57:06.204878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e6fae-fb43-4bb8-9f5c-6c0edec01c12 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:57:06.210700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:57:06.211521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:06.211803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:06.212079 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:06.220751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:57:06.222542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f103ab3-defb-4ee7-9e50-004597c45f3b service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:57:06.231987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1150/2339] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:57:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:57:09.414209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:09.414846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:09.414846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:09.445588 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] MFA Rules not processed for user `dafa7108bd954266a90728b62ad68a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:09.447833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:09.525665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1190/2340] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:57:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:57:16.228406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=61 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:19.518508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=25 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:23.857580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5a15-3c0b-4b17-b14c-39365d9e2d87 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:23.858104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5a15-3c0b-4b17-b14c-39365d9e2d87 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:23.858215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7c5a15-3c0b-4b17-b14c-39365d9e2d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:23.878831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7c7c5a15-3c0b-4b17-b14c-39365d9e2d87 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:23.880260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7c7c5a15-3c0b-4b17-b14c-39365d9e2d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:23.888320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1151/2341] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 01:57:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:57:23.900783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:57:23.912845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5e917-3779-435b-a186-86b9b7288488 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:57:23.917732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:57:23.918369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:23.918649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:23.918930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:23.927595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:57:23.929171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb006f3-f39a-480e-8a1a-cdf84ae43ab7 service swift] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:57:23.937383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1191/2342] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:57:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:57:33.873496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:33.934045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=6 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:39.768998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:57:39.769508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:57:39.769636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:57:39.788745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] MFA Rules not processed for user `5cc7c221754b4488adff9b193e8e0eec`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:57:39.789987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:57:39.843695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1152/2343] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:57:39 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:57:49.837078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=25 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:09.261190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eece1-68fa-4f8c-b721-1c2698c38641 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:09.261725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eece1-68fa-4f8c-b721-1c2698c38641 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:09.261725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977eece1-68fa-4f8c-b721-1c2698c38641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:09.282415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-977eece1-68fa-4f8c-b721-1c2698c38641 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:09.283868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-977eece1-68fa-4f8c-b721-1c2698c38641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:09.295968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1192/2344] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 01:58:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:09.321371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:09.340109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605702a2-9b3c-4b7e-8a58-14f39a552529 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:09.345843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:09.346695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:09.347041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:09.347524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:09.356763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:09.358965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c56cd8-d803-410c-8d02-3a0f7cb221c6 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:09.370150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1153/2345] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:58:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:58:13.163383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:13.163914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:13.167356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:13.193365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] MFA Rules not processed for user `2bb7b228b1b34b27bdb83357eef526c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:13.194833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:13.276066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1193/2346] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:18.192651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:18.193550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:18.194060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:18.219203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] MFA Rules not processed for user `a1f0fb63df7642eba4d93fc5d713c704`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:18.221140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:18.309645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1154/2347] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:18.432598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:18.435306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:18.534256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5fc4-0419-4939-b3cf-35b8321b7671 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:18.539197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:18.539846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:18.540129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:18.540404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] PATH_INFO: `/v3/users/6d6e0871c846405fa60b355a987f9b2c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:18.541555 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6e0871c846405fa60b355a987f9b2c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:18.543838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:18.603425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6e0871c846405fa60b355a987f9b2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:18.610943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6e0871c846405fa60b355a987f9b2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:18.611826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6e0871c846405fa60b355a987f9b2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:18.625335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6e0871c846405fa60b355a987f9b2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:18.632874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6e0871c846405fa60b355a987f9b2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:18.639748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1194/2348] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:58:18 2022] DELETE /identity/v3/users/6d6e0871c846405fa60b355a987f9b2c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:18.838172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:18.860419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e669d6-a2e4-4641-9e02-bae7d1e256dd None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:18.989630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:18.990419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:18.990794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:18.991164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] PATH_INFO: `/v3/projects/c04921f688c742a58c90e221cfe87810` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:18.992400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04921f688c742a58c90e221cfe87810)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:18.994462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:19.047434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04921f688c742a58c90e221cfe87810', 'request_id': 'req-b7465f24-eb32-4cb8-b0bb-49ff25845203'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.057469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04921f688c742a58c90e221cfe87810', 'request_id': 'req-b7465f24-eb32-4cb8-b0bb-49ff25845203'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.063796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04921f688c742a58c90e221cfe87810', 'request_id': 'req-b7465f24-eb32-4cb8-b0bb-49ff25845203'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.075579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] The token cache is being invalidate because project c04921f688c742a58c90e221cfe87810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:58:19.075876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.076557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.078094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1155/2349] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:58:18 2022] DELETE /identity/v3/projects/c04921f688c742a58c90e221cfe87810 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:19.082198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:19.083844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:19.096930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2039d01-0a70-4697-9068-a528b4f0cd52 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:19.109282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:19.157849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:19.158424 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:19.158709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:19.158984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] PATH_INFO: `/v3/users/19ae305f312e463ea33029c85fababf6` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:19.160617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ae305f312e463ea33029c85fababf6)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:19.162570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:19.208307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ae305f312e463ea33029c85fababf6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.218195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ae305f312e463ea33029c85fababf6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.218977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ae305f312e463ea33029c85fababf6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.232842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ae305f312e463ea33029c85fababf6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.240027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-29f438ee-45b8-459f-a15b-60cd35b59b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ae305f312e463ea33029c85fababf6'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.246134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1195/2350] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:58:19 2022] DELETE /identity/v3/users/19ae305f312e463ea33029c85fababf6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:58:19.418791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:19.420240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:19.433145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7465f24-eb32-4cb8-b0bb-49ff25845203 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:19.457389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:19.496983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:19.497613 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:19.497926 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:19.498227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] PATH_INFO: `/v3/projects/96423abb2eff4a249a94697931e9b07f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:19.499363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96423abb2eff4a249a94697931e9b07f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:19.501280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:19.549483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96423abb2eff4a249a94697931e9b07f', 'request_id': 'req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.557598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96423abb2eff4a249a94697931e9b07f', 'request_id': 'req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.563688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96423abb2eff4a249a94697931e9b07f', 'request_id': 'req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.577494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] The token cache is being invalidate because project 96423abb2eff4a249a94697931e9b07f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:58:19.577790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.578466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:19.579964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1156/2351] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:58:19 2022] DELETE /identity/v3/projects/96423abb2eff4a249a94697931e9b07f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:29.242595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=45,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:29.477684 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:29.478015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:29.478304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:29.497098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] MFA Rules not processed for user `dafa7108bd954266a90728b62ad68a37`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:29.498342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:29.561900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1196/2352] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:29.574574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:39.549592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=25 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:39.595162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:39.596792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:39.654114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51226fa2-0d16-46d9-9ad5-8c3051fd8a45 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:39.657659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:39.658305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:39.658580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:39.658855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:39.660710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:39.739314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:39.740793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:39.752966 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1157/2353] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:44.670374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:44.671917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:44.683788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8524a6c-8c02-4aaf-9cc3-8a7585dd22e5 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:44.687315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:44.687915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:44.688193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:44.688463 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:44.690812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:44.704422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:44.706524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:44.717797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1197/2354] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:47.059619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:47.069068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caa8d16-c527-4dd6-92d4-714bc2a4bb94 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:47.072868 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:47.073493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:47.073771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:47.074071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:47.075819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:47.148845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:47.150326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:47.160628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1158/2355] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:50.725636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:50.727200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:50.741795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282ae1a-e325-47b1-bf1b-bfd77b9179c1 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:50.746327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:50.746952 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:50.747232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:50.747505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] PATH_INFO: `/v3/users/5cc7c221754b4488adff9b193e8e0eec` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:50.748614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc7c221754b4488adff9b193e8e0eec)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:50.750567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:50.798041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc7c221754b4488adff9b193e8e0eec'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:50.806490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc7c221754b4488adff9b193e8e0eec'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:50.807120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc7c221754b4488adff9b193e8e0eec'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:50.819763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc7c221754b4488adff9b193e8e0eec'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:50.826480 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-95337f46-48c3-49d7-8e4b-ffdf85a5f54c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc7c221754b4488adff9b193e8e0eec'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:50.836194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1198/2356] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:58:50 2022] DELETE /identity/v3/users/5cc7c221754b4488adff9b193e8e0eec => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:51.014928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.025769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a33500-1365-4cb1-8eb1-39abc697c2f4 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.059006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:51.084019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.084683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.084965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.085240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] PATH_INFO: `/v3/projects/37cd8c478d884b70a2e19ca24fb46829` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.086441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37cd8c478d884b70a2e19ca24fb46829)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.088374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.133064 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cd8c478d884b70a2e19ca24fb46829', 'request_id': 'req-917eb780-9c52-4dd2-92b1-ab3f69e104e1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:51.140465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cd8c478d884b70a2e19ca24fb46829', 'request_id': 'req-917eb780-9c52-4dd2-92b1-ab3f69e104e1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:51.147226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cd8c478d884b70a2e19ca24fb46829', 'request_id': 'req-917eb780-9c52-4dd2-92b1-ab3f69e104e1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:51.159009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] The token cache is being invalidate because project 37cd8c478d884b70a2e19ca24fb46829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:58:51.159236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:51.159869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-917eb780-9c52-4dd2-92b1-ab3f69e104e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:51.161347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1159/2357] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:58:51 2022] DELETE /identity/v3/projects/37cd8c478d884b70a2e19ca24fb46829 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:58:51.166361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.166652 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.166928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.189938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:51.191142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:51.248667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1199/2358] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:51.256633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.256939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.257209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.278921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:51.280158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:51.288784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1160/2359] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:51.293025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.302726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980860ac-7a67-4ede-b210-a4af8a3d89dc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.307352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.307946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.308228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.308502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.309144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:58:51.309450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.311063 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.322311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1200/2360] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:58:51.326432 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.335911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1661546-d051-4635-a4c1-c3e1def11d58 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.340501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.341085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.341363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.341635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.342317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.344219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.371169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1161/2361] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:58:51.375421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.388015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3885623e-e71b-4bef-bdc7-b74d3067d180 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.431849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:51.446358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.446971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.447256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.447535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.448172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.450156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.472258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1201/2362] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:58:51.476402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.486579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c48d5-c2d0-472b-a841-7d9bd56ed188 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.491168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.491761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.492042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.492314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.492952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.494701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.504826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1162/2363] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:58:51.508455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.519311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d21e0-c58e-47a0-814c-87692002e560 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.523922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.524507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.524791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.525066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.525704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.527329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89915a4c-1b9c-4269-9f7d-844ebc6f8134 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.537546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1202/2364] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:58:51.541412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.551364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc810813-203e-4f84-b3ba-7e0a42615753 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.556014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.556651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.556931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.557205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] PATH_INFO: `/v3/projects/488b3dfa99fa44598aa1be2b27106e61/users/2563fcf96e674f50a72c2fd6864a7055/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.575195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488b3dfa99fa44598aa1be2b27106e61, user_id=2563fcf96e674f50a72c2fd6864a7055, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.577960 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.592860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1163/2365] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:58:51 2022] PUT /identity/v3/projects/488b3dfa99fa44598aa1be2b27106e61/users/2563fcf96e674f50a72c2fd6864a7055/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:51.602910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.603214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.603493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.630934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] MFA Rules not processed for user `2563fcf96e674f50a72c2fd6864a7055`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:51.632144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:51.696159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1203/2366] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:51.700781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.762301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e021f1-1f3b-4874-91d6-47973441e100 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.766956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.768076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.768356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.768633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.769269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.771204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.776457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:51.800024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1164/2367] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:58:51.804248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.814827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d34bb-92ba-4406-805a-d11fe3208d0e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.872280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.872935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.873211 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.873493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.874162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.876105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.902225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1204/2368] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:58:51 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:58:51.903413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.914404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ba9a8-5ea0-4b16-8d30-6544385b8fe1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.919094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.919685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.919962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.920247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.920870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.922487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.933297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1165/2369] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:58:51.937671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:51.948689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc2eb28-3613-4c79-b6c6-c6012ba54d75 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:51.953838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:51.954828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:51.955179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:51.956056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] PATH_INFO: `/v3/projects/a176c8dd4478455986a0cfc672e2f4c7/users/fb33e73f6b7f479a8f6c4132ae7dbd67/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:51.972603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a176c8dd4478455986a0cfc672e2f4c7, user_id=fb33e73f6b7f479a8f6c4132ae7dbd67, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:51.975433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:51.988676 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1205/2370] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:58:51 2022] PUT /identity/v3/projects/a176c8dd4478455986a0cfc672e2f4c7/users/fb33e73f6b7f479a8f6c4132ae7dbd67/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:58:51.992584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:52.003516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ef9c93-77a0-49d2-95d2-bfbbf1bb4e18 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:52.062980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:52.063584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:52.063853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:52.064122 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:52.065039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:52.066655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193c0c4-513a-454c-8b05-4b38958f9af2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:52.076718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1166/2371] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:58:52.081401 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:52.091763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7840fc-de9f-461a-9f58-bb60e03884f8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:52.096888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:52.097543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:52.097822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:52.098125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] PATH_INFO: `/v3/projects/a176c8dd4478455986a0cfc672e2f4c7/users/fb33e73f6b7f479a8f6c4132ae7dbd67/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:52.100009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a176c8dd4478455986a0cfc672e2f4c7, user_id=fb33e73f6b7f479a8f6c4132ae7dbd67, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:52.102690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:52.112526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1206/2372] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:58:52 2022] PUT /identity/v3/projects/a176c8dd4478455986a0cfc672e2f4c7/users/fb33e73f6b7f479a8f6c4132ae7dbd67/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:52.123681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:52.123968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:52.124245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:52.152791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] MFA Rules not processed for user `fb33e73f6b7f479a8f6c4132ae7dbd67`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:52.154040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:52.225790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1167/2373] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:52.236833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:52.238545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:52.248374 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:52.304179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0758885-6d7c-4aad-bf09-460d5a45977f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:52.308067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:52.308685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:52.308969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:52.309246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:52.319023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:52.320509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:52.329982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1207/2374] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:52.407084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:52.416748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c48761-24bd-4049-a6d4-0de87b09b057 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:52.420317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:52.420914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:52.421194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:52.421466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:52.476381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:52.479000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:52.480913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc83528f-beca-47db-b143-686b2c087417 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:52.491660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1168/2375] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:59.271991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:59.332433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf5409-e1b3-4aa8-becd-ad65210ecddd service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:59.336916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:59.337543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:59.337825 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:59.338129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] PATH_INFO: `/v3/users/2563fcf96e674f50a72c2fd6864a7055` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:59.339261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2563fcf96e674f50a72c2fd6864a7055)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:59.341143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:59.385418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2563fcf96e674f50a72c2fd6864a7055'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.391898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2563fcf96e674f50a72c2fd6864a7055'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.392614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2563fcf96e674f50a72c2fd6864a7055'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.404330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2563fcf96e674f50a72c2fd6864a7055'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.411030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2563fcf96e674f50a72c2fd6864a7055'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.416771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1208/2376] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:58:59 2022] DELETE /identity/v3/users/2563fcf96e674f50a72c2fd6864a7055 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:59.421342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:59.421814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:59.421939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:59.442776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:58:59.444025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:59.501271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1169/2377] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:58:59.511689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:59.513088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:59.544225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:59.573922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb317468-49d2-4365-a5f8-08f739e0410f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:59.577534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:59.578165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:59.578445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:59.578715 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:59.587759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:59.589175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:59.599107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1209/2378] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:58:59.873120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:59.877700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:58:59.889959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d579e5c-aa26-4d54-8e2a-7a557f073737 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:58:59.894987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:58:59.895771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:58:59.896054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:58:59.896326 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] PATH_INFO: `/v3/projects/488b3dfa99fa44598aa1be2b27106e61` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:58:59.897453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488b3dfa99fa44598aa1be2b27106e61)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:58:59.899457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:58:59.950524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488b3dfa99fa44598aa1be2b27106e61', 'request_id': 'req-acdad4e0-39f5-4569-90da-f186841dfaf1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.959360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488b3dfa99fa44598aa1be2b27106e61', 'request_id': 'req-acdad4e0-39f5-4569-90da-f186841dfaf1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.965376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488b3dfa99fa44598aa1be2b27106e61', 'request_id': 'req-acdad4e0-39f5-4569-90da-f186841dfaf1'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.977704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] The token cache is being invalidate because project 488b3dfa99fa44598aa1be2b27106e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:58:59.978096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.978750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:58:59.980234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1170/2379] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:58:59 2022] DELETE /identity/v3/projects/488b3dfa99fa44598aa1be2b27106e61 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:58:59.984275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:58:59.994381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c91e7b-2139-48ec-bcca-0308c8b7789e service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.050111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.050751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.051062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.051341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] PATH_INFO: `/v3/users/fb33e73f6b7f479a8f6c4132ae7dbd67` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.052451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb33e73f6b7f479a8f6c4132ae7dbd67)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.054469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.100314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb33e73f6b7f479a8f6c4132ae7dbd67'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.107631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb33e73f6b7f479a8f6c4132ae7dbd67'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.108280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb33e73f6b7f479a8f6c4132ae7dbd67'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.119982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb33e73f6b7f479a8f6c4132ae7dbd67'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.126677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d74116d-88b7-4985-866e-83a308387b33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb33e73f6b7f479a8f6c4132ae7dbd67'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.134453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1210/2380] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:58:59 2022] DELETE /identity/v3/users/fb33e73f6b7f479a8f6c4132ae7dbd67 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:00.405767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.407227 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:00.422071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdad4e0-39f5-4569-90da-f186841dfaf1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.480026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.480582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.480863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.481141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] PATH_INFO: `/v3/projects/a176c8dd4478455986a0cfc672e2f4c7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.482289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a176c8dd4478455986a0cfc672e2f4c7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.484199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.507013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:00.532131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a176c8dd4478455986a0cfc672e2f4c7', 'request_id': 'req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.538999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a176c8dd4478455986a0cfc672e2f4c7', 'request_id': 'req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.544715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a176c8dd4478455986a0cfc672e2f4c7', 'request_id': 'req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.555542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] The token cache is being invalidate because project a176c8dd4478455986a0cfc672e2f4c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:00.555834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.556463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f9b2aac6-2469-4e86-bbf1-f165e8c7a842 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:00.558605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1171/2381] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:00 2022] DELETE /identity/v3/projects/a176c8dd4478455986a0cfc672e2f4c7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:00.563449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.563962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.564077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.584322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:00.585523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:00.628654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:00.645751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1211/2382] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:00.653623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.653940 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.654221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.673715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:00.674946 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:00.683258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1172/2383] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:00.687400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.697619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8c274e-8014-4a51-a15c-3df300b0b444 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.702182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.702776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.703065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.703343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.703989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:00.704299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.705910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.717872 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1212/2384] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:00.722649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.732023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006e9e9-c83b-419e-b11c-57704967103b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.736572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.737165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.737446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.737719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.738901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.740801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.770862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1173/2385] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:00 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:00.772219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.782353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08850d0-6e4c-44d4-8e00-99cb42d139ba admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.837710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.838345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.838625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.838896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.839526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.841428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.862001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1213/2386] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:00 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:00.866641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.876876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b48d-7927-4bf3-a0c5-c2c31d276499 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.882113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.882720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.882998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.883272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.883911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.885776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.895483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1174/2387] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:00.899261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.909123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcf883-ed98-41cb-ad01-5d66b3f9f648 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.913827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.914450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.914735 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.915011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.915669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.917247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506a26-b3f2-47dc-b1ba-767f1b57176b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.928020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1214/2388] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:00.931833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:00.942270 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c8a68-cef8-4b59-b0b9-4e21f8782e7b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:00.946850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:00.947484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.947765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.948038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] PATH_INFO: `/v3/projects/48e53ff57f5745f194c0a464feb8052d/users/006afa58ca4c472da357c9f08b9ef35c/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:00.962288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e53ff57f5745f194c0a464feb8052d, user_id=006afa58ca4c472da357c9f08b9ef35c, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:00.964924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:00.977586 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1175/2389] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:00 2022] PUT /identity/v3/projects/48e53ff57f5745f194c0a464feb8052d/users/006afa58ca4c472da357c9f08b9ef35c/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:00.988995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:00.989275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:00.990069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.017929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] MFA Rules not processed for user `006afa58ca4c472da357c9f08b9ef35c`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:01.019170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:01.084200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1215/2390] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:01.088733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.151741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998fbc48-23fc-4b53-a1d7-8f19dfb6d5e6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.156601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.157234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.157544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.157817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.158485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.160383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.191346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1176/2391] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:01.195342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.205833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6991de6a-a488-4771-a47a-cf76ffae596f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.248300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:01.261687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.262427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.262709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.262983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.263615 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.265549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.285855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1216/2392] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:01.290373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.304522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08ddd9f-219d-40dc-b9b2-d0db80e77b53 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.309165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.309767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.310082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.310357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.311000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.312635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.323161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1177/2393] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:01.327039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.336959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee11bc-6024-4d81-b34a-2e2491f7fcfd admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.341504 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.342126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.342407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.342682 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.343318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.344882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f85b0-d1f4-444a-83d6-340a5a6dfd23 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.355077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1217/2394] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:01.359123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.369564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8da747b-f632-4406-be04-8488c58ba025 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.374442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.375088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.375371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.375651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] PATH_INFO: `/v3/projects/4ffebe0066334244b420870fa2d518e2/users/544e20bf684d45449735ae64c3396358/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.390215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ffebe0066334244b420870fa2d518e2, user_id=544e20bf684d45449735ae64c3396358, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.392876 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.396452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:01.407554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1178/2395] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:01 2022] PUT /identity/v3/projects/4ffebe0066334244b420870fa2d518e2/users/544e20bf684d45449735ae64c3396358/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:01.418269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.418574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.418849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.446540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] MFA Rules not processed for user `544e20bf684d45449735ae64c3396358`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:01.447769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:01.511328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1218/2396] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:01.515783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.576219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e7e9bb-7da4-466f-b6b0-69e43e4d7b42 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.580824 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.581421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.581706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.582040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.582666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.585086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.611123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1179/2397] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:01.615285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.625803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0e472-a968-4475-89db-641bba202fa3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.681413 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.682051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.682338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.682610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.683224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.685118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.706435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1219/2398] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:01.711093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.721397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a575d8-f958-414a-b7f4-db931b08fdd9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.726798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.727417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.727721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.727994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.728688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.730357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.741981 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1180/2399] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:01.746417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.756364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad74cde-2cdd-469d-b3f3-6412290e8e79 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.761212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.761963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.762197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.762471 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] PATH_INFO: `/v3/projects/c0ee2cf23dfd4f3290027a70babe2659/users/3674d6987c614717aa8f4f0ba0c7ac47/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.778024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ee2cf23dfd4f3290027a70babe2659, user_id=3674d6987c614717aa8f4f0ba0c7ac47, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.780855 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.794649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1220/2400] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:01 2022] PUT /identity/v3/projects/c0ee2cf23dfd4f3290027a70babe2659/users/3674d6987c614717aa8f4f0ba0c7ac47/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:01.798828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.808750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22d0c49-b851-4509-9caf-a132c2ec3af9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.863811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.864418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.864811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.864989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.865621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.867245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c356a31-30b1-4ea1-9dfb-ae2e06ceb08d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.876739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1181/2401] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:01.881534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:01.891877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a2c837-7e2d-4489-99d6-9263fbf5c3c2 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:01.897067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:01.897707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.898029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.898303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] PATH_INFO: `/v3/projects/c0ee2cf23dfd4f3290027a70babe2659/users/3674d6987c614717aa8f4f0ba0c7ac47/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.900188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0ee2cf23dfd4f3290027a70babe2659, user_id=3674d6987c614717aa8f4f0ba0c7ac47, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:01.902914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:01.912845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1221/2402] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:01 2022] PUT /identity/v3/projects/c0ee2cf23dfd4f3290027a70babe2659/users/3674d6987c614717aa8f4f0ba0c7ac47/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:01.922663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:01.922956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:01.923232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:01.950505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] MFA Rules not processed for user `3674d6987c614717aa8f4f0ba0c7ac47`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:01.951698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:02.000537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:02.019838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1182/2403] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:02.031548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:02.033246 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:02.043007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:02.092042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf23e3d-b4a6-43c9-8b4b-ce539451de66 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:02.095661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:02.096270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:02.096552 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:02.096828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:02.105814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:02.107272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:02.116566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1222/2404] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:02 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:02.623630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:02.625048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:02.636978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9e53b5-86b5-4c78-9bb8-29ec219baec2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:02.640455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:02.641049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:02.641329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:02.641597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:02.696983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:02.698489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:02.707285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1183/2405] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:05.802627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:05.804094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:05.875913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa9ff-6952-4839-93e2-9254b0765b20 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:05.881407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:05.882066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:05.882351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:05.882631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:05.884342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:05.940935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:05.942560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:05.951239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1223/2406] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:06.729589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:06.738242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534f08f-b2cb-4bda-86bc-1f7e34138b4c service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:06.741823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:06.742513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:06.742791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:06.743062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:06.799247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:06.800791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00309891-6e21-4163-b383-162faeda79ae service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:06.810022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1184/2407] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:08.922310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:08.972608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:08.988328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c28da-6b95-4b78-b5f4-7ad882e6d5e6 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:08.994521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:08.995768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:08.996274 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:08.996756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] PATH_INFO: `/v3/users/006afa58ca4c472da357c9f08b9ef35c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:08.998717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] RBAC: Authorizing `identity:delete_user(user_id=006afa58ca4c472da357c9f08b9ef35c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:09.000962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:09.050710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006afa58ca4c472da357c9f08b9ef35c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.059097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006afa58ca4c472da357c9f08b9ef35c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.059755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006afa58ca4c472da357c9f08b9ef35c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.073307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006afa58ca4c472da357c9f08b9ef35c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.080172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006afa58ca4c472da357c9f08b9ef35c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.086292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1224/2408] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:08 2022] DELETE /identity/v3/users/006afa58ca4c472da357c9f08b9ef35c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:09.090889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:09.091374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:09.091719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:09.111414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:09.112528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:09.184575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1185/2409] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:09.195064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:09.196498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:09.258157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac719a78-e678-43e9-a5b5-936d2a9c689d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:09.263820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:09.264422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:09.264701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:09.264988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:09.274594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:09.276007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:09.285731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1225/2410] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:09.551623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:09.553091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:09.565411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d77fa0-c3c3-4e26-bd16-7f65edabcc2e None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:09.570790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:09.571693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:09.571693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:09.571974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] PATH_INFO: `/v3/projects/48e53ff57f5745f194c0a464feb8052d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:09.573190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e53ff57f5745f194c0a464feb8052d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:09.575089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:09.601489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:09.624001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e53ff57f5745f194c0a464feb8052d', 'request_id': 'req-0e97ef25-1a33-4b5b-87fb-c0369baf3239'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.632163 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e53ff57f5745f194c0a464feb8052d', 'request_id': 'req-0e97ef25-1a33-4b5b-87fb-c0369baf3239'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.638196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e53ff57f5745f194c0a464feb8052d', 'request_id': 'req-0e97ef25-1a33-4b5b-87fb-c0369baf3239'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.649237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] The token cache is being invalidate because project 48e53ff57f5745f194c0a464feb8052d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:09.649526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.650196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.651700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1186/2411] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:09 2022] DELETE /identity/v3/projects/48e53ff57f5745f194c0a464feb8052d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:09.655706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:09.665285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3abe5e-433e-4487-afc4-10411a390c53 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:09.721056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:09.721683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:09.722001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:09.722280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] PATH_INFO: `/v3/users/544e20bf684d45449735ae64c3396358` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:09.723402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] RBAC: Authorizing `identity:delete_user(user_id=544e20bf684d45449735ae64c3396358)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:09.725370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:09.735206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:09.772249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544e20bf684d45449735ae64c3396358'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.778780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544e20bf684d45449735ae64c3396358'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.779531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544e20bf684d45449735ae64c3396358'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.791214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544e20bf684d45449735ae64c3396358'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.797989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544e20bf684d45449735ae64c3396358'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:09.804228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1226/2412] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:09 2022] DELETE /identity/v3/users/544e20bf684d45449735ae64c3396358 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:10.077638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:10.079106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:10.091832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97ef25-1a33-4b5b-87fb-c0369baf3239 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:10.148419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:10.149105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.149327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.149620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] PATH_INFO: `/v3/projects/4ffebe0066334244b420870fa2d518e2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.150739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ffebe0066334244b420870fa2d518e2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:10.152668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:10.197587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ffebe0066334244b420870fa2d518e2', 'request_id': 'req-1c58e024-4a49-44fa-8ccc-1e050c83b721'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.205507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ffebe0066334244b420870fa2d518e2', 'request_id': 'req-1c58e024-4a49-44fa-8ccc-1e050c83b721'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.211195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ffebe0066334244b420870fa2d518e2', 'request_id': 'req-1c58e024-4a49-44fa-8ccc-1e050c83b721'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.222121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] The token cache is being invalidate because project 4ffebe0066334244b420870fa2d518e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:10.222415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.223443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.224869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1187/2413] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:10 2022] DELETE /identity/v3/projects/4ffebe0066334244b420870fa2d518e2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:10.229381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:10.230841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:10.244403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc44266-cf5b-4afd-9e0e-c9297086700b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:10.305253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:10.305914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.306239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.306499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] PATH_INFO: `/v3/users/3674d6987c614717aa8f4f0ba0c7ac47` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.307651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3674d6987c614717aa8f4f0ba0c7ac47)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:10.309578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:10.355863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3674d6987c614717aa8f4f0ba0c7ac47'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.369501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3674d6987c614717aa8f4f0ba0c7ac47'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.370630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3674d6987c614717aa8f4f0ba0c7ac47'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.385062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3674d6987c614717aa8f4f0ba0c7ac47'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.392338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-909eafa2-be2e-4e78-980d-ba60386dfd4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3674d6987c614717aa8f4f0ba0c7ac47'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.399303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1227/2414] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:10 2022] DELETE /identity/v3/users/3674d6987c614717aa8f4f0ba0c7ac47 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:10.687895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:10.689378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:10.702650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58e024-4a49-44fa-8ccc-1e050c83b721 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:10.746340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:10.764874 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:10.765534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.765814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.766119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] PATH_INFO: `/v3/projects/c0ee2cf23dfd4f3290027a70babe2659` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.767237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0ee2cf23dfd4f3290027a70babe2659)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:10.769154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:10.817999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0ee2cf23dfd4f3290027a70babe2659', 'request_id': 'req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.825852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0ee2cf23dfd4f3290027a70babe2659', 'request_id': 'req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.831382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0ee2cf23dfd4f3290027a70babe2659', 'request_id': 'req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.842744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] The token cache is being invalidate because project c0ee2cf23dfd4f3290027a70babe2659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:10.843030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.843682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-252d0cdc-4ba5-4e6b-8b16-b6ba52c6edbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:10.845170 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1188/2415] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:10 2022] DELETE /identity/v3/projects/c0ee2cf23dfd4f3290027a70babe2659 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:10.851350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.851641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.851921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.866585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:10.873047 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:10.875297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:10.940734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1228/2416] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:10.949608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.949921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.950204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.970057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:10.971276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:10.979317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1189/2417] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:10.983617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:10.993262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf754c36-9dbd-4357-8765-0c5b3b73ee4c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:10.998026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:10.998635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:10.998920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:10.999200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:10.999878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:11.000187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.001777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.014126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1229/2418] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:11.018452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.028209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aece55ed-7661-431d-8e02-0f874f18fa3b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.033327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.034072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.034415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.034712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.035365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.037305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.068733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1190/2419] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:11.070459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.080707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb5869-0a99-4d74-8caa-56585ffcd382 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.144152 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.144766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.145049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.145325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.146001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.148445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.185404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1230/2420] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/users => generated 296 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:11.189536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.208979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152393f-93b1-4729-9cd1-ec7bef163eea admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.214779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.215391 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.215670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.215992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.216635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.218581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.231034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1191/2421] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:11.235174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.247195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d48825-aeec-45b3-8036-4c3941e2afd3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.251941 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.252661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.253005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.253344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.254109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.256064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e57a5-392d-4b90-ad56-2f17f82c5f83 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.267926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1231/2422] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:11.272814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.283120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab96d37-5b50-4a7e-86ac-9681d12af888 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.288285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.288935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.289216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.289489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] PATH_INFO: `/v3/projects/71b60f3c2d7d4de88938d276a9b44e5a/users/c572e39cf0db4e2d8aaf9e78ebe4c579/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.304662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=71b60f3c2d7d4de88938d276a9b44e5a, user_id=c572e39cf0db4e2d8aaf9e78ebe4c579, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.307333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.320185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1192/2423] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:11 2022] PUT /identity/v3/projects/71b60f3c2d7d4de88938d276a9b44e5a/users/c572e39cf0db4e2d8aaf9e78ebe4c579/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:11.331543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.331847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.332128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.360408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] MFA Rules not processed for user `c572e39cf0db4e2d8aaf9e78ebe4c579`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:11.361621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:11.426943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1232/2424] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:11.431658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.492939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b447bb2-9306-4f63-aef2-93d21c42e9bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.497584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.498216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.498499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.498771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.499399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.501347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.516292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:11.529389 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1193/2425] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:11.533477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.539624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:11.547058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a8ec-7593-4b8d-a219-ea1252df4862 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.602529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.603131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.603415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.603694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.604314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.606356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.627875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1233/2426] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:11.631802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.642384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b4081d-dea6-45d3-a2c9-7ea913be1434 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.647223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.647834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.648117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.648505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.649240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.650930 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.661789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1194/2427] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:11.678164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.678164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da070de-cd56-487a-a12e-4714961e3c04 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.682033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.682746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.683039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.683319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] PATH_INFO: `/v3/projects/d0591f3a0f1048b0a92b6d2809516b13/users/4c8683d093eb4f9f90f7dc9e0d543504/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.698983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0591f3a0f1048b0a92b6d2809516b13, user_id=4c8683d093eb4f9f90f7dc9e0d543504, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.701631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.714320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1234/2428] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:11 2022] PUT /identity/v3/projects/d0591f3a0f1048b0a92b6d2809516b13/users/4c8683d093eb4f9f90f7dc9e0d543504/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:11.718376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.728796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6f9e-e43e-40a9-8512-3268dbf78f3c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.784655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.785352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.785776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.786316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.787870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.789430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d02ba-1a65-406f-ba9c-ac314664c4ca admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.802920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1195/2429] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:11.804488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.815810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0fe258-ca38-4d5d-8f62-1f2838051cb0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:11.821042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:11.821700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.822038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.822304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] PATH_INFO: `/v3/projects/d0591f3a0f1048b0a92b6d2809516b13/users/4c8683d093eb4f9f90f7dc9e0d543504/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.824434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0591f3a0f1048b0a92b6d2809516b13, user_id=4c8683d093eb4f9f90f7dc9e0d543504, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:11.827172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:11.840268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1235/2430] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:11 2022] PUT /identity/v3/projects/d0591f3a0f1048b0a92b6d2809516b13/users/4c8683d093eb4f9f90f7dc9e0d543504/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:11.851973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:11.852349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:11.852695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:11.881292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] MFA Rules not processed for user `4c8683d093eb4f9f90f7dc9e0d543504`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:11.882553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:11.955529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1196/2431] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:11.966879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:11.968570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:12.024866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac5d0ff-123f-4ccc-9f8d-c2124055b137 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:12.028443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:12.029037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:12.029320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:12.029593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:12.038935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:12.040349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:12.049625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1236/2432] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:12.096189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:12.097562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:12.109989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc201c4-0fe4-4cb2-bbc2-d2bbb705d927 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:12.113608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:12.114244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:12.114527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:12.114799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:12.170151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:12.171582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ce44b-3ab8-4dba-acbb-07dac79b4404 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:12.180354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1197/2433] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:12 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:15.489491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:15.548360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:15.552695 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54829726-d5db-4fa4-8745-78981855a892 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:15.557903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:15.558563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:15.558843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:15.559136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] PATH_INFO: `/v3/users/c572e39cf0db4e2d8aaf9e78ebe4c579` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:15.560229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c572e39cf0db4e2d8aaf9e78ebe4c579)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:15.562193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:15.608975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c572e39cf0db4e2d8aaf9e78ebe4c579'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:15.617545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c572e39cf0db4e2d8aaf9e78ebe4c579'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:15.618189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c572e39cf0db4e2d8aaf9e78ebe4c579'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:15.630956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c572e39cf0db4e2d8aaf9e78ebe4c579'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:15.640574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c572e39cf0db4e2d8aaf9e78ebe4c579'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:15.646668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1237/2434] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:15 2022] DELETE /identity/v3/users/c572e39cf0db4e2d8aaf9e78ebe4c579 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:15.651046 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:15.651510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:15.651769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:15.659124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:15.673370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:15.674665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:15.741518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1198/2435] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:15.751345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:15.754269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:15.814464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1241f-e17f-47f5-ae57-326044684e6e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:15.818135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:15.819433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:15.819716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:15.819987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:15.829067 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:15.830520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:15.840251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1238/2436] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:16.128555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:16.130160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:16.143867 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc9cd1-6cbd-48dd-9638-777ad1d0e67b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:16.150680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:16.151263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.151546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.151819 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] PATH_INFO: `/v3/projects/71b60f3c2d7d4de88938d276a9b44e5a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.152983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=71b60f3c2d7d4de88938d276a9b44e5a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:16.155714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:16.212759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71b60f3c2d7d4de88938d276a9b44e5a', 'request_id': 'req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.223693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71b60f3c2d7d4de88938d276a9b44e5a', 'request_id': 'req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.230560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71b60f3c2d7d4de88938d276a9b44e5a', 'request_id': 'req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.243196 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] The token cache is being invalidate because project 71b60f3c2d7d4de88938d276a9b44e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:16.243670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.244928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.246744 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1199/2437] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:16 2022] DELETE /identity/v3/projects/71b60f3c2d7d4de88938d276a9b44e5a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:16.250746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:16.261423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4315bac-e9da-4e05-9bae-fe592bd1512d service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:16.327132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:16.327764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.328049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.328321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] PATH_INFO: `/v3/users/4c8683d093eb4f9f90f7dc9e0d543504` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.329432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c8683d093eb4f9f90f7dc9e0d543504)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:16.331372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:16.353910 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:16.382128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c8683d093eb4f9f90f7dc9e0d543504'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.390479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c8683d093eb4f9f90f7dc9e0d543504'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.391100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c8683d093eb4f9f90f7dc9e0d543504'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.404764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c8683d093eb4f9f90f7dc9e0d543504'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.411562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-99160eec-1527-4b22-8bbe-576e317f72c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c8683d093eb4f9f90f7dc9e0d543504'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.419848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1239/2438] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:16 2022] DELETE /identity/v3/users/4c8683d093eb4f9f90f7dc9e0d543504 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:16.681475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:16.682987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:16.697396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f638fa0-1b1a-4bff-b608-0cf27dcc4eaf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:16.753843 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:16.754589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.754873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.755147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] PATH_INFO: `/v3/projects/d0591f3a0f1048b0a92b6d2809516b13` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.756884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0591f3a0f1048b0a92b6d2809516b13)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:16.758865 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:16.790155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:16.807398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0591f3a0f1048b0a92b6d2809516b13', 'request_id': 'req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.814347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0591f3a0f1048b0a92b6d2809516b13', 'request_id': 'req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.819899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0591f3a0f1048b0a92b6d2809516b13', 'request_id': 'req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.830890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] The token cache is being invalidate because project d0591f3a0f1048b0a92b6d2809516b13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:16.831182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.831826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-79f6d7f3-80fc-4b0a-960d-ab7df003d7a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:16.833306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1200/2439] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:16 2022] DELETE /identity/v3/projects/d0591f3a0f1048b0a92b6d2809516b13 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:16.838265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.838763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.838870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.858400 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:16.859607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:16.917414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1240/2440] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:16.925333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.925559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.925831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.946512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:16.947748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:16.955611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1201/2441] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:16.959893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:16.969521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a210d4-403c-43cb-9c11-6d8f2552ccbe None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:16.974119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:16.975221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:16.975502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:16.975773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:16.976440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:16.976742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:16.978338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:16.989505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1241/2442] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:16.994237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.003435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c4ae36-d6fa-48fa-bc5e-87fa66943022 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.008108 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.008700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.008984 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.009259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.010191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.012089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.041531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1202/2443] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:16 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:17.042900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.053556 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4fbb-97a8-4bd4-9c90-d5253a1816ba admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.113778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.114421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.114710 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.114990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.116273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.118257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.139122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1242/2444] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:17 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:17.143248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.153964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c80d9-096a-4bb5-a662-9493f94a6131 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.158544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.159135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.159421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.159700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.160340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.161969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.172213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1203/2445] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:17.175967 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.186048 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c592ad1-4b3f-4843-8249-0e71adbe3742 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.190772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.191396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.191678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.191953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.192591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.194224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978a460-0c05-4a9e-85e1-175999bc87a7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.204712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1243/2446] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:17.214496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.224698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735345b-b3f1-4573-b7ca-d548790ccacc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.229681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.230362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.230641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.230915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] PATH_INFO: `/v3/projects/b9722757a6044079b699113251b9874f/users/1a958a03532a4bbb80d50e6bd5c8412e/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.245119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9722757a6044079b699113251b9874f, user_id=1a958a03532a4bbb80d50e6bd5c8412e, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.247791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.260792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1204/2447] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:17 2022] PUT /identity/v3/projects/b9722757a6044079b699113251b9874f/users/1a958a03532a4bbb80d50e6bd5c8412e/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:17.271235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.272073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.272356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.281196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:17.303793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] MFA Rules not processed for user `1a958a03532a4bbb80d50e6bd5c8412e`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:17.305119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:17.369262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1244/2448] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:17.380633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:17.382409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:17.449924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d59d25-8dcf-4943-b05c-8593b08fa3e9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:17.453512 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:17.454144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:17.454425 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:17.454699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:17.463735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:17.465160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:17.474020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1205/2449] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:18.389157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:18.390567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:18.471513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecbf3e-40ee-4bdb-894c-4c99cd198e65 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:18.477755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:18.478432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:18.478873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:18.479155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:18.481602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:18.544218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:18.546266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:18.557490 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1245/2450] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:24.090814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:24.092716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:24.154273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11788f18-743a-4ccb-bd1e-456016933bb5 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:24.159102 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:24.159758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:24.160041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:24.160320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:24.162695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:24.176155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:24.240513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:24.242019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3bc359-72e2-446e-9f17-bd7723b77649 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:24.251677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1206/2451] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:26.020966 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:26.063673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0cb37c-61e4-4f5b-95c9-9358f749ce9e service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:26.089101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:26.092340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:26.093000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:26.093508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:26.098243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:26.136460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:26.138162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:26.170334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1246/2452] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:27.304607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf7d3e-38ae-49cb-b2fe-7882fb38a66a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:27.305127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf7d3e-38ae-49cb-b2fe-7882fb38a66a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:27.305212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaf7d3e-38ae-49cb-b2fe-7882fb38a66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:27.337724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8eaf7d3e-38ae-49cb-b2fe-7882fb38a66a None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:27.339023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8eaf7d3e-38ae-49cb-b2fe-7882fb38a66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:27.467066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1207/2453] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:59:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:27.534498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:27.536046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:27.558924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:27.634101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c07c1-7387-48a4-a73c-d05e23a1caaf service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:27.641978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:27.644033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:27.644561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:27.645649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:27.660271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:27.662975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4debc9-4182-4e57-bb86-62c018f6ceb1 service swift] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:27.695955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1247/2454] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:59:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 01:59:28.863721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:28.864231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:28.864343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:28.866065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1208/2455] 10.222.0.33 () {54 vars in 961 bytes} [Fri Sep 16 01:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:59:28.871275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:28.871824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:28.871824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:28.906236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] MFA Rules not processed for user `87b1d9cc1b0c482eae5661be121abb18`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:28.907804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:28.931556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:28.933489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:28.953456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049640ff-13d6-4b31-ade7-d2347a37980b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:28.959236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:28.960454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:28.960738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:28.961011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] PATH_INFO: `/v3/users/2bb7b228b1b34b27bdb83357eef526c7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:28.962197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb7b228b1b34b27bdb83357eef526c7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:28.964401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:29.003639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1248/2456] 10.222.0.33 () {58 vars in 1058 bytes} [Fri Sep 16 01:59:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:29.016284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:29.037421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f134-4eb4-4cf6-950f-adccd5f26037 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:29.047267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb7b228b1b34b27bdb83357eef526c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.049087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:29.049708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:29.050833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:29.053222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:29.057479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:29.065418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb7b228b1b34b27bdb83357eef526c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.082823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb7b228b1b34b27bdb83357eef526c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.084246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb7b228b1b34b27bdb83357eef526c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.084507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:29.086167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:29.094331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1503b6a6-92d2-401b-af4f-4ba919e4406d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb7b228b1b34b27bdb83357eef526c7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.104436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1249/2457] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:29.108452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1209/2458] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:28 2022] DELETE /identity/v3/users/2bb7b228b1b34b27bdb83357eef526c7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:29.336360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:29.350895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c52048-1864-45ee-9194-deb4e70d74ce service placement] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:29.448567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:29.449714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:29.450222 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:29.450686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] PATH_INFO: `/v3/projects/7cc2bba458bf4cc3aae276ecd83fa7b4` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:29.452267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc2bba458bf4cc3aae276ecd83fa7b4)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:29.456017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:29.520561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:29.587975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc2bba458bf4cc3aae276ecd83fa7b4', 'request_id': 'req-e66073a6-e240-45e9-b751-96fe324b10c8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.606837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc2bba458bf4cc3aae276ecd83fa7b4', 'request_id': 'req-e66073a6-e240-45e9-b751-96fe324b10c8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.626815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc2bba458bf4cc3aae276ecd83fa7b4', 'request_id': 'req-e66073a6-e240-45e9-b751-96fe324b10c8'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.666810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] The token cache is being invalidate because project 7cc2bba458bf4cc3aae276ecd83fa7b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:29.668258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.669745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.673546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1250/2459] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:29 2022] DELETE /identity/v3/projects/7cc2bba458bf4cc3aae276ecd83fa7b4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:29.679854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:29.680139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:29.680408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:29.689988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:29.691470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:29.718888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:29.720791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:29.746109 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:29.817637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1210/2460] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:29.819682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:29.821376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:29.850099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66073a6-e240-45e9-b751-96fe324b10c8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:29.877277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:29.878053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:29.878249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:29.878770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] PATH_INFO: `/v3/users/1a958a03532a4bbb80d50e6bd5c8412e` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:29.882397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a958a03532a4bbb80d50e6bd5c8412e)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:29.886700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:29.953387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9650b4-5e11-479b-a6f0-3a653650354c None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:29.953969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a958a03532a4bbb80d50e6bd5c8412e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.962880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:29.963748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:29.964253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:29.964781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:29.966840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:29.967844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a958a03532a4bbb80d50e6bd5c8412e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.970366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a958a03532a4bbb80d50e6bd5c8412e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:29.983154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:29.984830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce4e8a-7c0f-44ec-8b9a-c54fd25f4709 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:29.990237 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a958a03532a4bbb80d50e6bd5c8412e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:30.000419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1211/2461] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:30.001464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-70a167fd-232c-44e2-9180-ddd8c6aa0d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a958a03532a4bbb80d50e6bd5c8412e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:30.002286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.002879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.003317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.010982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1251/2462] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:29 2022] DELETE /identity/v3/users/1a958a03532a4bbb80d50e6bd5c8412e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:30.016566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.018036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.018373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.032736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:30.034015 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.062498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:30.065446 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.120415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:30.131915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1212/2463] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:30.137106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.153753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d996ea-5193-4def-98a2-89ddbd0f8693 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.163743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.164864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.165377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.165899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.166777 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:30.167409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.171157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1252/2464] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:30.173751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.179387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.181158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.196082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1213/2465] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:30.200275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.216842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd325b2-fe77-4ebc-910e-79071db7e07a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.222904 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.223763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.224268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.224774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.225661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.227886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.287297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1214/2466] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:30 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:30.287917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0314c8-7af7-4d99-8dd1-c79b1e7232fc None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.296812 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.323125 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:30.351531 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.352390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.352751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.353095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.406592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1764d5-c3c5-4f43-a44d-4a76902fe851 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.412691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.413301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.413583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.413898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.414558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.416529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.435189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.439892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.453941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1215/2467] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:30 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:30.454184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1253/2468] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:30.456404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.468479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a2fd99-389d-4c53-af1a-e85138d75220 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.474894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.475946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.475946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.476240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.476863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.478945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.493711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1254/2469] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:30.495000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.507908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32545a29-297c-469d-9601-48f9c2f8db7b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.516676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.517364 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.517642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.517949 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.519058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.520640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd427a95-4a2c-4bc8-857b-5b975804aa2a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.536891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1216/2470] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:30.538487 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.551367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39cccfe-a068-4de2-8a5e-4989e0bb5186 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.564427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.565145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.565426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.565702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] PATH_INFO: `/v3/projects/021467e538044239a8faddcaf15bb72d/users/f0d60492d95d4b669b4eb6607955c3ff/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.587771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=021467e538044239a8faddcaf15bb72d, user_id=f0d60492d95d4b669b4eb6607955c3ff, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.590567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.624423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.624639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.624988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1255/2471] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:30 2022] PUT /identity/v3/projects/021467e538044239a8faddcaf15bb72d/users/f0d60492d95d4b669b4eb6607955c3ff/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:30.625138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.683837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] MFA Rules not processed for user `f0d60492d95d4b669b4eb6607955c3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:30.685058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.787702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1217/2472] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:30.798015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.804381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:30.805160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.812830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:30.843736 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:30.934484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6110e67-135d-48ca-8502-27c97a3d722b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.937153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb598da-b70f-4687-9b4d-99ab1b8034b8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:30.939779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.940631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.940995 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.941343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] PATH_INFO: `/v3/projects/b9722757a6044079b699113251b9874f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.942597 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9722757a6044079b699113251b9874f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.943875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:30.944632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:30.944919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:30.945194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:30.945569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.956755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:30.959304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f2c0e-a875-4665-985f-dc1ae45f864f service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:30.973411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1256/2473] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:30.979896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:31.016952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9722757a6044079b699113251b9874f', 'request_id': 'req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.032217 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9722757a6044079b699113251b9874f', 'request_id': 'req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.040514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9722757a6044079b699113251b9874f', 'request_id': 'req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.057457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] The token cache is being invalidate because project b9722757a6044079b699113251b9874f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:31.057759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.058896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-56fdd5d3-fbd8-4279-9f47-53c0ae88f059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.061086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1218/2474] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:30 2022] DELETE /identity/v3/projects/b9722757a6044079b699113251b9874f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:31.070870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.070870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.070870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.096389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:31.097700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.244578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1257/2475] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:31.245444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.245736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.246050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.273274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:31.274603 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.313296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1219/2476] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:31.317423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.329569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db25ad53-d7be-467d-b060-4c34eaf58020 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.342682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.342972 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.344692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.345241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.345525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.345798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.346547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:31.346876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.349800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.361611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a056f-e3c0-4174-a474-80dbfb557745 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.375897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.376564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.376842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.377119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] PATH_INFO: `/v3/users/f0d60492d95d4b669b4eb6607955c3ff` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.378410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d60492d95d4b669b4eb6607955c3ff)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.379794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1258/2477] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:31.380625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.385342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.400098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84447efa-1586-48c2-bd57-8064686057bd admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.408541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.409497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.409975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.410331 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.412618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.415804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.450055 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d60492d95d4b669b4eb6607955c3ff'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.458072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1259/2478] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:31.463112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.468913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d60492d95d4b669b4eb6607955c3ff'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.488213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d60492d95d4b669b4eb6607955c3ff'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.490711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d60492d95d4b669b4eb6607955c3ff'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.515727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-586fae99-9370-45be-87b9-27715a8971f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d60492d95d4b669b4eb6607955c3ff'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:31.531114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1220/2479] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:31 2022] DELETE /identity/v3/users/f0d60492d95d4b669b4eb6607955c3ff => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:31.539724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.540150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.540441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.576901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:31.578403 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.589605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c29e4f3-2494-4f5d-9240-d21ef4e82f4c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.595497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:31.679488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1221/2480] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:31.687785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.688699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.688991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.689266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.690005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.691115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.692090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.692763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.725552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:31.729470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1260/2481] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:31.736498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.738523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:31.752073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80e09a7-6809-4232-bdc8-0497cf732430 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.757738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.758468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.758841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.759215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.760209 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.762024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.773076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a0dd6d-e8a6-4394-832c-0bc5bad7ee70 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.774251 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1261/2482] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:31.784621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.791138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.791780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.792069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.792346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.808939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.810468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.816546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44305279-b480-4a47-9ba7-7c1a7c2c5101 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.821954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.822659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.823039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.823383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.824095 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.825749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0066c20c-3cd7-4536-b5f1-f6e5fb5b65c0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.830051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1222/2483] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:31.837774 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1262/2484] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:31 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:31.842932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:31.854006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba535-1450-4889-8ee1-9687bf84e3fe service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:31.859023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:31.859701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.860302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.860302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] PATH_INFO: `/v3/projects/5ac7605a48ec480ba59a903f54e6667d/users/b0269073354c47e0880e62184ee7fa40/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.877785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac7605a48ec480ba59a903f54e6667d, user_id=b0269073354c47e0880e62184ee7fa40, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:31.881891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:31.906911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1223/2485] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:31 2022] PUT /identity/v3/projects/5ac7605a48ec480ba59a903f54e6667d/users/b0269073354c47e0880e62184ee7fa40/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:31.919661 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:31.920107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:31.920489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:31.956385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] MFA Rules not processed for user `b0269073354c47e0880e62184ee7fa40`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:31.957800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.046768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1263/2486] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:32.061860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.063907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.129606 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63b0a4-50a1-4acd-86c4-64aef992254e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.133900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.134823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.135103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.135375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.144764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.146955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175fd9a-7dae-4c50-a60c-d7e92dc7cea8 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.156653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1224/2487] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:32.201023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.203167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.315007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158cb14c-16cd-4c95-9d0d-f9b4d6011177 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.321348 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.322484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.322879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.323519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] PATH_INFO: `/v3/projects/021467e538044239a8faddcaf15bb72d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.324745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=021467e538044239a8faddcaf15bb72d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.326820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.337500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:32.394675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '021467e538044239a8faddcaf15bb72d', 'request_id': 'req-bcb79592-749c-4405-b147-f402a0b0bfcf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:32.407324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '021467e538044239a8faddcaf15bb72d', 'request_id': 'req-bcb79592-749c-4405-b147-f402a0b0bfcf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:32.416493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '021467e538044239a8faddcaf15bb72d', 'request_id': 'req-bcb79592-749c-4405-b147-f402a0b0bfcf'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:32.431230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] The token cache is being invalidate because project 021467e538044239a8faddcaf15bb72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:32.431595 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:32.432352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:32.434441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1264/2488] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:32 2022] DELETE /identity/v3/projects/021467e538044239a8faddcaf15bb72d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:32.440147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e009ec-ade2-4873-aeff-9e1d4b069759 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.441118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e009ec-ade2-4873-aeff-9e1d4b069759 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.441629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e009ec-ade2-4873-aeff-9e1d4b069759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.489026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d3e009ec-ade2-4873-aeff-9e1d4b069759 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:32.491047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d3e009ec-ade2-4873-aeff-9e1d4b069759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.571526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.573428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.580828 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1225/2489] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:32.588378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.590334 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.590775 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.628655 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:32.631988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.671526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1226/2490] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:32.675556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.686356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb79592-749c-4405-b147-f402a0b0bfcf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.691052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b5192-15a6-4fdf-9a0e-cdeec5a88a7b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.691262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.691871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.692151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.693021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.697605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:32.703314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.704315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.704804 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.705307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.706330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:32.706892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.709168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.718565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.720392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.726727 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1227/2491] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:59:32.732720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.744708 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1265/2492] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:32.745773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37483a3-a4e1-41b3-ae1d-39d2156eacee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.750642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.751258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.751907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.752212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.753022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.756375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.786198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:32.803083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1228/2493] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:32 2022] POST /identity/v3/projects => generated 379 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:32.804435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.815876 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9e084-419d-4104-91c7-13b237b4eb05 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.914814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.915549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.915905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.916316 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.917054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.919097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.945821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1266/2494] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:32 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:32.949479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:32.962814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7ef9e-23c7-48dd-ad17-4c262cb55f42 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:32.970204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:32.971303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:32.971303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:32.971524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:32.972027 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:32.973667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:32.985999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1229/2495] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:32.991935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.008216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b35a2c-796e-4593-8f60-1048fe672490 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.019111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.019754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.020042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.020322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.021566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.023351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694be4ff-59c3-4d5c-aa96-ff32783255a6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.044074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1267/2496] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:33.048483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.061549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c310f2-f0e3-4c0b-b523-4a4c90ddb79e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.068232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.069091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.069495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.070004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] PATH_INFO: `/v3/projects/13a6b999aef84e2994c1f8c137ee3c67/users/3cd731601bd84c0190b6b4f320974e52/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.088415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a6b999aef84e2994c1f8c137ee3c67, user_id=3cd731601bd84c0190b6b4f320974e52, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.091365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.118906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1230/2497] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:33 2022] PUT /identity/v3/projects/13a6b999aef84e2994c1f8c137ee3c67/users/3cd731601bd84c0190b6b4f320974e52/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:33.122980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.123611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.124094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.156616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] MFA Rules not processed for user `3cd731601bd84c0190b6b4f320974e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:33.158258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:33.169973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:33.248093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1268/2498] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:33.253920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.339707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61986ac-5fad-4dbd-ac37-e43b8c7d79c4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.345349 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.346066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.346354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.346636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.347285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.352095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.389797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1231/2499] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:33 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:33.393549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.410416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b27901-eadc-4d9f-b80e-babeb778925a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.486757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.487477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.487822 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.488179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.488932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.490938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.526997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1269/2500] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:33 2022] POST /identity/v3/users => generated 296 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:33.528641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.550994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69f967-88a4-4e2b-a05a-7776c37674d1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.556650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.557339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.557619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.558047 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.558814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.560715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.579628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1232/2501] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:33.579835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.595491 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a02a64-7a2f-47ff-8339-f2fa6c7e8422 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.609758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.610596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.610947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.612009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] PATH_INFO: `/v3/projects/9604cc5bd83947db82ee8dc352575ad2/users/d48f998cb7d147d487bd147250e979a4/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.628892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9604cc5bd83947db82ee8dc352575ad2, user_id=d48f998cb7d147d487bd147250e979a4, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.632594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.657915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.676862 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08264052-ec63-41eb-8308-8bba0b07ee91 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.679404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1270/2502] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:33 2022] PUT /identity/v3/projects/9604cc5bd83947db82ee8dc352575ad2/users/d48f998cb7d147d487bd147250e979a4/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:33.823384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.824014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.824301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.824578 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.825370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.826972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d85277b-f108-4851-9487-058364f6b7f1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.852580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1233/2503] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:33.857847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:33.881198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01db3d12-32d4-4f79-b6e8-8bb7d7f160f8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:33.893964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:33.894699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.894980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.895498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] PATH_INFO: `/v3/projects/9604cc5bd83947db82ee8dc352575ad2/users/d48f998cb7d147d487bd147250e979a4/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.901928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9604cc5bd83947db82ee8dc352575ad2, user_id=d48f998cb7d147d487bd147250e979a4, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:33.911524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:33.930351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1271/2504] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:33 2022] PUT /identity/v3/projects/9604cc5bd83947db82ee8dc352575ad2/users/d48f998cb7d147d487bd147250e979a4/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:33.947759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:33.948100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:33.948439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:33.991657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] MFA Rules not processed for user `d48f998cb7d147d487bd147250e979a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:33.992948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:34.028540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:34.144889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1234/2505] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:34.156807 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:34.159753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:34.311204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac5334-a884-4a2d-9d2e-4d8bbc539be3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:34.320094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:34.320963 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:34.321415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:34.321841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:34.362358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:34.504896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:34.507542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf00d3f-c762-414b-b974-f647600ec78f service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:34.520384 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1272/2506] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:35.830643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:35.835010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:35.934700 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c8e01-1df4-4c6f-8bf8-c51612b138e2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:35.944787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:35.945452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:35.945796 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:35.946029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] PATH_INFO: `/v3/users/b0269073354c47e0880e62184ee7fa40` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:35.947616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0269073354c47e0880e62184ee7fa40)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:35.949133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:36.012385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0269073354c47e0880e62184ee7fa40'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:36.024021 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0269073354c47e0880e62184ee7fa40'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:36.040701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0269073354c47e0880e62184ee7fa40'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:36.042100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0269073354c47e0880e62184ee7fa40'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:36.054402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0269073354c47e0880e62184ee7fa40'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:36.063344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1235/2507] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:35 2022] DELETE /identity/v3/users/b0269073354c47e0880e62184ee7fa40 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:36.068364 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:36.069225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:36.069711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:36.105147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:36.107225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:36.129323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:36.131798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:36.221678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:36.243163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1273/2508] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:36.256212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:36.256212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:36.263964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf2eb7-f973-4482-944b-68ce01cc6d2c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:36.280306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:36.280952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:36.281241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:36.282410 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:36.285399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:36.375133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9caff4-cceb-4364-88d5-09327d43a267 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:36.379817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:36.381479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:36.382005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:36.382525 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:36.391039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:36.393838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:36.395784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:36.398379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb3c3f-dc9f-4c1e-b0c1-581032d9f266 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:36.414866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1274/2509] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:36.415866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1236/2510] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:36 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:37.025654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.027357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.059341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8429f-3617-4dc0-85c7-67eb7ee2eead service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.081274 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.082160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.082587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.083263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] PATH_INFO: `/v3/projects/5ac7605a48ec480ba59a903f54e6667d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.086880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac7605a48ec480ba59a903f54e6667d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.089351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.253314 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac7605a48ec480ba59a903f54e6667d', 'request_id': 'req-a1ac3b7b-a6ce-4ea8-a664-77105efef001'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:37.276790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac7605a48ec480ba59a903f54e6667d', 'request_id': 'req-a1ac3b7b-a6ce-4ea8-a664-77105efef001'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:37.290028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac7605a48ec480ba59a903f54e6667d', 'request_id': 'req-a1ac3b7b-a6ce-4ea8-a664-77105efef001'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:37.314520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] The token cache is being invalidate because project 5ac7605a48ec480ba59a903f54e6667d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:37.315362 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:37.316295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-a1ac3b7b-a6ce-4ea8-a664-77105efef001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:37.318805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1237/2511] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:37 2022] DELETE /identity/v3/projects/5ac7605a48ec480ba59a903f54e6667d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:37.323135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.323645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.323760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.359015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:37.360611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.437802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:37.453114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1275/2512] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:37.461677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.462025 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.462298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.488411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:37.491661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.510374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1238/2513] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:37.514696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.528703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128bce2a-6ca2-42cd-9a18-8a9544242ab2 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.535821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.536799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.537317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.538532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.539433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:37.539959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.543199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.583449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1276/2514] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:59:37.635307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.645360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192365a4-bd89-4a38-9898-0f67a9136c1f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.651360 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.651985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.652272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.652554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.652779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.653211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.655035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.655154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.716176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1239/2515] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:37 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:37.718732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.830669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4228f-603f-47ab-b66f-db15672c2ca5 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.833832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:37.876347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509de9c4-daa4-49fc-a1c2-b5d4c2d79399 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.882564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.883111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.883388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.883660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.884301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.886670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.920515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1240/2516] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:37 2022] POST /identity/v3/users => generated 292 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:37.924340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:37.924598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.938685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.939284 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.939565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.939841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.941991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:37.955820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde76ae6-fc66-496b-ad86-b99911e11bf1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:37.958308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.960454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.964688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:37.965341 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:37.965628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:37.965972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] PATH_INFO: `/v3/users/dafa7108bd954266a90728b62ad68a37` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:37.967972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dafa7108bd954266a90728b62ad68a37)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:37.969967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:37.974803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1277/2517] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:37.976070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.000210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78ea75-0061-48ea-9db6-6c9bec85011c service placement] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.006450 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.007685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.008165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.008641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.010488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.013282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.037794 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1278/2518] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:38.042271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.055858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc332a-afb5-4abf-a8f1-b9bb89951791 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.061528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.062243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.062526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.062803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.063627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.065838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.067838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dafa7108bd954266a90728b62ad68a37'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.080355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1279/2519] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:38.084692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dafa7108bd954266a90728b62ad68a37'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.089452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.107008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16ac66-154f-4608-a917-f3ac19ab4f71 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.111996 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dafa7108bd954266a90728b62ad68a37'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.113066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dafa7108bd954266a90728b62ad68a37'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.113694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.115281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.115790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.116814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] PATH_INFO: `/v3/projects/5a0dd6d05c8847068977b8bbc616ace8/users/52d7dbbcff0f489ba311cab525dd3869/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.136096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-04b46da0-8e52-4bb6-bdb5-66bcbce12513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dafa7108bd954266a90728b62ad68a37'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.145229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1241/2520] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:37 2022] DELETE /identity/v3/users/dafa7108bd954266a90728b62ad68a37 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:38.150299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0dd6d05c8847068977b8bbc616ace8, user_id=52d7dbbcff0f489ba311cab525dd3869, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.157473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.200742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1280/2521] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:38 2022] PUT /identity/v3/projects/5a0dd6d05c8847068977b8bbc616ace8/users/52d7dbbcff0f489ba311cab525dd3869/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:38.203164 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.203530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.203895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.273245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] MFA Rules not processed for user `52d7dbbcff0f489ba311cab525dd3869`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:38.277229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.368749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1242/2522] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:38.373128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.375426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.415393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:38.457024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a5351-b7bf-4f67-9b1e-0d920fa785bf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.463645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.465557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.466150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.466788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.468570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.472168 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.528278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.530000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.537638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1281/2523] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:38.542711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.559311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3b99a-5f0b-42e4-bfb2-62bab2cc5f2a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.610670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:38.649451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be48fce-5870-4689-ae39-fac86e0d263b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.656706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.657598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.657726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.658065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.658457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.658614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] PATH_INFO: `/v3/projects/306f4565a4dd46e381add34b6d50c4d3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.658857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.659292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.659951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.660188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=306f4565a4dd46e381add34b6d50c4d3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.662451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.662595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.700834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1282/2524] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/users => generated 293 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:38.705430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.720690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a3bac-5681-4db0-94e5-3caba380d07d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.726558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '306f4565a4dd46e381add34b6d50c4d3', 'request_id': 'req-10be763e-a8d2-4c41-b9e2-34b7c579aae3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.736179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '306f4565a4dd46e381add34b6d50c4d3', 'request_id': 'req-10be763e-a8d2-4c41-b9e2-34b7c579aae3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.751708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '306f4565a4dd46e381add34b6d50c4d3', 'request_id': 'req-10be763e-a8d2-4c41-b9e2-34b7c579aae3'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.767630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] The token cache is being invalidate because project 306f4565a4dd46e381add34b6d50c4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:38.768500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.768844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-10be763e-a8d2-4c41-b9e2-34b7c579aae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:38.775958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1243/2525] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:38 2022] DELETE /identity/v3/projects/306f4565a4dd46e381add34b6d50c4d3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:38.777628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.777972 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.778255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.802119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:38.803849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.805603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.806452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.806726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.806999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.807699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.809669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ef1ed-0429-4815-90e2-62e086be762d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.819336 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1244/2526] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:38.823050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1283/2527] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:38.831965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.834854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.844781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.845257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.845601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.856758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbc162c-3478-4b4f-8881-e3e22b7faef9 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.868752 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.870525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.871018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.871473 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.872455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.874869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.888168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1245/2528] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:38.890773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:38.892183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:38.893234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.907593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1284/2529] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:38.911548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:38.917038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836579e-484a-464a-88f3-997969a5c6d4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.923029 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.924100 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.924614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.924888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] PATH_INFO: `/v3/projects/d5a05abb92e24b66a961a9d83c26e12e/users/bb20839d11ef450ea80e5ebf3170f704/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.945144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0c482-85fb-41cb-b84d-79c9f0ffcdac None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:38.947139 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a05abb92e24b66a961a9d83c26e12e, user_id=bb20839d11ef450ea80e5ebf3170f704, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.949691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cacb254-a01e-4ceb-b62f-ca78c8f39c7d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.968561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:38.969452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.969913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.970337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:38.971171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:38.971627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:38.973732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:38.974177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1246/2530] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:38 2022] PUT /identity/v3/projects/d5a05abb92e24b66a961a9d83c26e12e/users/bb20839d11ef450ea80e5ebf3170f704/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:38.984186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:38.984731 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:38.985088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.001338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1285/2531] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:59:39.004614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.018193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2094145-4007-45a0-b253-283d0ba18a95 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.035154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] MFA Rules not processed for user `bb20839d11ef450ea80e5ebf3170f704`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:39.036776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:39.040412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:39.091739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.092947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.093286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.093698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.094547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.097337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.132042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1247/2532] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:39.133509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.147636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1286/2533] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:39.149268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.153345 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572de154-98d4-43bc-8aeb-f86b85438c15 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.165342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:39.227763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb46a95-6e59-46f8-b411-3656ba05fdc0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.231486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.232445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.233083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.233821 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.234802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.236371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.237058 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.237345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.237681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.238358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.238469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.240809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.274248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1287/2534] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/users => generated 284 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:39.278390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.281943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1248/2535] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:39.285342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.294557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ddd075-bc7a-445b-9f2e-db0c82b63c61 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.375964 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5058cc-2c7b-4164-8bb2-d2f504255f7a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.386625 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.387386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.387678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.387971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.388642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.390864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.419795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1249/2536] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/users => generated 297 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:39.423507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.435221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b428e4e-c424-4ac1-bcec-d861b01582ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.442247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.443478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.443845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.444157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.445554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.447383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.451824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.452723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.453115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.453663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.454492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.457418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.463769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1250/2537] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:39.464665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.477404 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b98363-2630-4231-8b5a-585938a10ea7 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.481426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1288/2538] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:39.486188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.486590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.487394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.487694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.488036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] PATH_INFO: `/v3/projects/11b855c59d0848f1851f777bf6c76d04/users/cc649e2bf5c547d1823bde7ad9246e4d/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.502423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b5437a-09cd-4b68-99ae-1b27464e9ae5 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.505446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b855c59d0848f1851f777bf6c76d04, user_id=cc649e2bf5c547d1823bde7ad9246e4d, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.508392 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.509712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.510653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.511122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.511728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.512623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.514816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.535978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1289/2540] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:39.536254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1251/2540] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:39 2022] PUT /identity/v3/projects/11b855c59d0848f1851f777bf6c76d04/users/cc649e2bf5c547d1823bde7ad9246e4d/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:39.536989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.537544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.552142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf68c45-2ee9-4613-8d53-f3f406591e22 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.573248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:39.638346 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:39.655032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ec72-1f8f-46f8-8175-c3f5dbb30f60 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.662793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.663577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.664116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.666604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] PATH_INFO: `/v3/projects/e60b395f998b4c82af0e12cb9bbf65b8/users/383af32f98ff494d85e08e40adeba358/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.670727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.671289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.671569 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.671846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.672495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.678390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.699629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e60b395f998b4c82af0e12cb9bbf65b8, user_id=383af32f98ff494d85e08e40adeba358, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.702428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727242f-e6f6-417d-a2a3-4070965d5b0d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.710006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1290/2541] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:39.711359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.731719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4465-0e53-40f1-8c21-fd839669fa15 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:39.735721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1252/2542] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:39 2022] PUT /identity/v3/projects/e60b395f998b4c82af0e12cb9bbf65b8/users/383af32f98ff494d85e08e40adeba358/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:39.747229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.747879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.749290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.816248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] MFA Rules not processed for user `383af32f98ff494d85e08e40adeba358`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:39.820280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:39.872419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:39.873262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.873654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.874026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] PATH_INFO: `/v3/projects/11b855c59d0848f1851f777bf6c76d04/users/cc649e2bf5c547d1823bde7ad9246e4d/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.876054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b855c59d0848f1851f777bf6c76d04, user_id=cc649e2bf5c547d1823bde7ad9246e4d, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:39.878921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e09dd-3991-4cbd-900b-18526c30d1f8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:39.894097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1291/2543] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:39 2022] PUT /identity/v3/projects/11b855c59d0848f1851f777bf6c76d04/users/cc649e2bf5c547d1823bde7ad9246e4d/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:39.909045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:39.909564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:39.910135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:39.958094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] MFA Rules not processed for user `cc649e2bf5c547d1823bde7ad9246e4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:39.960106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:39.983045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1253/2544] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:39.992106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:39.994644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:40.077813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1292/2545] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:40.079725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ec49c4-0c0d-4301-a032-4b6057460cf4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:40.090475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:40.093645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:40.148353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:40.148353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:40.148353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:40.148353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:40.157759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:40.198949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d191a3f-3fc6-4870-a3bd-e2dbc6c0b097 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:40.199442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:40.203045 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:40.203658 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:40.204060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:40.204247 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:40.206148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:40.229733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:40.231483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:40.253958 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1254/2546] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:40.293228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:40.295579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900e4ad2-303f-4833-9c11-409f54ce4e48 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:40.308131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1293/2547] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:40 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:40.777504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:40.778969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:40.860470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba6b8b-dae2-4e53-abcc-9fabf9e7ce74 service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:40.869623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:40.870289 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:40.870567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:40.870839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] PATH_INFO: `/v3/users/3cd731601bd84c0190b6b4f320974e52` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:40.872149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cd731601bd84c0190b6b4f320974e52)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:40.874134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:40.941853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cd731601bd84c0190b6b4f320974e52'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:40.955535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cd731601bd84c0190b6b4f320974e52'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:40.972285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cd731601bd84c0190b6b4f320974e52'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:40.973132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cd731601bd84c0190b6b4f320974e52'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:40.982468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cd731601bd84c0190b6b4f320974e52'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:40.988928 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1255/2548] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:40 2022] DELETE /identity/v3/users/3cd731601bd84c0190b6b4f320974e52 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:40.993571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:40.994094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:40.994206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:41.033139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:41.035954 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:41.121947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1294/2549] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:41.132888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:41.134871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:41.200531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600e62f-3974-48fa-bc74-a3c4e0fd10dd admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:41.204007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:41.204615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:41.204893 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:41.205166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:41.212911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:41.215676 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:41.218044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:41.229518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1256/2550] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:41.496799 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:41.498273 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:41.511928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa938b02-13fc-43b0-b0c1-773f65fec04c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:41.516671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:41.517377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:41.517738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:41.518078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] PATH_INFO: `/v3/projects/13a6b999aef84e2994c1f8c137ee3c67` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:41.519820 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a6b999aef84e2994c1f8c137ee3c67)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:41.522662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:41.570325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a6b999aef84e2994c1f8c137ee3c67', 'request_id': 'req-cd484461-7dd4-4403-8926-c1536abd79f7'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.577299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a6b999aef84e2994c1f8c137ee3c67', 'request_id': 'req-cd484461-7dd4-4403-8926-c1536abd79f7'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.582866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a6b999aef84e2994c1f8c137ee3c67', 'request_id': 'req-cd484461-7dd4-4403-8926-c1536abd79f7'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.594078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] The token cache is being invalidate because project 13a6b999aef84e2994c1f8c137ee3c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:41.594363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.594977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.596414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1295/2551] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:41 2022] DELETE /identity/v3/projects/13a6b999aef84e2994c1f8c137ee3c67 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:41.600707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:41.610696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a461c-5f2b-47fb-8ef0-7495802cb97e service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:41.672604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:41.673357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:41.673636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:41.673934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] PATH_INFO: `/v3/users/d48f998cb7d147d487bd147250e979a4` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:41.675076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48f998cb7d147d487bd147250e979a4)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:41.677213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:41.736758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48f998cb7d147d487bd147250e979a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.743818 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48f998cb7d147d487bd147250e979a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.758734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48f998cb7d147d487bd147250e979a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.760259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48f998cb7d147d487bd147250e979a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.769007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48f998cb7d147d487bd147250e979a4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:41.781060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1257/2552] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:41 2022] DELETE /identity/v3/users/d48f998cb7d147d487bd147250e979a4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:41.791858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:41.793955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:41.840359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:41.911465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd484461-7dd4-4403-8926-c1536abd79f7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:41.958264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:41.960096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.000475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.002081 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.002527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.003059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.006171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.026618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.029499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.042901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b3c66-3215-42a2-ac40-7382aa10a123 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.043834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1296/2553] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:42.047643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.048262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.048730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.049183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.051281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.090562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:42.148448 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.150033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded6d39-4ef9-4e1a-a565-173453373a0f service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.164165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1258/2554] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:42.247206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.248692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.354622 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe022daa-4898-4a98-a63b-979d19b70a06 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.360304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.360929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.361249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.361524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] PATH_INFO: `/v3/projects/9604cc5bd83947db82ee8dc352575ad2` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.363202 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9604cc5bd83947db82ee8dc352575ad2)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.369249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.424672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9604cc5bd83947db82ee8dc352575ad2', 'request_id': 'req-e8e93698-f806-4602-8d6b-dbb3b38a109e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:42.433992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9604cc5bd83947db82ee8dc352575ad2', 'request_id': 'req-e8e93698-f806-4602-8d6b-dbb3b38a109e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:42.441125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9604cc5bd83947db82ee8dc352575ad2', 'request_id': 'req-e8e93698-f806-4602-8d6b-dbb3b38a109e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:42.456976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] The token cache is being invalidate because project 9604cc5bd83947db82ee8dc352575ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:42.457580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:42.459075 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e8e93698-f806-4602-8d6b-dbb3b38a109e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:42.463971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1297/2555] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:42 2022] DELETE /identity/v3/projects/9604cc5bd83947db82ee8dc352575ad2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:42.465891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.466462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.466462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.488889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:42.490297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.559639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1259/2556] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:42.568447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.568782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.569065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.579262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:42.592627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:42.595153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.608372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1298/2557] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:42.613637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.624869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ca5bf-b570-4288-b139-96ebe627f135 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.629618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.630913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.631192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.631486 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.632210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:42.632551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.634250 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.647010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1260/2558] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:42.651391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.661819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f94f00-0de9-48b9-ba00-1577f9b69aed None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.666982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.667669 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.667988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.668353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.669071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.671272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.699916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1299/2559] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:42 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:42.704254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.715644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064aa25c-f763-4ca7-aef7-b0b6cccbdbdb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.773284 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.773924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.774233 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.774698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.775146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.777038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.803922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1261/2560] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:42 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:42.805098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.817263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca91577-88e0-4379-829e-7e9b32f8c7fe admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.820839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.821462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.821748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.822065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.822707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.824286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.834542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1300/2561] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:42.838368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.848540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52f6b-b0b2-4967-b003-9b9a5698c284 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.853072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.853441 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.853674 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.853992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.854271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.854906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.855127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.856497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.870678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1262/2562] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:42.871813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:42.882417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ab96c-ee8a-44ef-81c0-e999c9f85cb1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.887237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.887872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.888150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.888427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] PATH_INFO: `/v3/projects/fd11a87b20aa4b4e88d3f90a03a93bdb/users/2e052d56beb24b31b790fcf13218a97c/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.902590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd11a87b20aa4b4e88d3f90a03a93bdb, user_id=2e052d56beb24b31b790fcf13218a97c, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.905238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f2f139-3e6a-4230-8aca-442c03ed55a0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:42.912664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd39288-0d8e-4f23-bdf7-9864a6ee0f47 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:42.916609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:42.917208 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.917498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.917769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.919501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.920531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1263/2563] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:42 2022] PUT /identity/v3/projects/fd11a87b20aa4b4e88d3f90a03a93bdb/users/2e052d56beb24b31b790fcf13218a97c/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:42.932269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:42.932562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:42.932845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:42.953743 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:42.962243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] MFA Rules not processed for user `2e052d56beb24b31b790fcf13218a97c`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:42.963889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:42.989068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:42.991092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.000394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1301/2564] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:43.028210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1264/2565] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:43.032674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.043929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2803a-0f18-43e6-9bc5-2c54fc9ab2d9 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.111930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.112547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.112824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.113102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.113734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.116291 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.137079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:43.143797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1302/2566] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:43 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:43.148072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.158937 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55d53c-0a91-4e82-860e-6243cf19f4ad None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.217263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.217872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.218203 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.218478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.219101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.221470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.247897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1265/2567] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:43 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:43.249032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.268223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e50fa5-7af3-4ec2-a6b3-ed57107b0621 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.274440 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.276033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.276405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.276692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.277408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.279050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.293971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1303/2568] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:43.295166 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.305511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fe0c19-6c7d-4e63-b21d-ed48d9b8d3fa admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.310252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.310907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.311188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.311469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] PATH_INFO: `/v3/projects/2132fc3eec094f8992e84ac2b168d2ac/users/232b28f39fff49c6b07dbd377cb1ad2c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.331259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2132fc3eec094f8992e84ac2b168d2ac, user_id=232b28f39fff49c6b07dbd377cb1ad2c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.334662 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.348493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1266/2569] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:43 2022] PUT /identity/v3/projects/2132fc3eec094f8992e84ac2b168d2ac/users/232b28f39fff49c6b07dbd377cb1ad2c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:43.353399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.366030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f339a4-ec6b-487d-af9f-8e62c5a52c19 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.430984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.431600 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.431878 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.432161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.432804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.434478 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff7218-3a9a-4d99-8472-94935b997e80 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.447578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1304/2570] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:43.452105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.463232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b0728-0299-4777-9b1b-22cd4be01168 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.470237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.471745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.472244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.472768 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] PATH_INFO: `/v3/projects/2132fc3eec094f8992e84ac2b168d2ac/users/232b28f39fff49c6b07dbd377cb1ad2c/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.474914 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2132fc3eec094f8992e84ac2b168d2ac, user_id=232b28f39fff49c6b07dbd377cb1ad2c, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.477820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.490070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1267/2571] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:43 2022] PUT /identity/v3/projects/2132fc3eec094f8992e84ac2b168d2ac/users/232b28f39fff49c6b07dbd377cb1ad2c/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:43.500987 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.501277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.501565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.535059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] MFA Rules not processed for user `232b28f39fff49c6b07dbd377cb1ad2c`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:43.536546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:43.616645 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1305/2572] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:43.626635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.698298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b900a5f8-d598-487c-983c-e13828c9f631 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.702329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.702956 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.703237 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.703528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.711084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:43.713728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.715783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe724fe-e311-45fd-a50c-468ebdc9ac5b service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.725846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1268/2573] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:43.791197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:43.854985 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deda2e1-cb96-4898-90d6-baf58c7f0e76 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:43.859628 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:43.860200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.860477 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.860751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] PATH_INFO: `/v3/users/2e052d56beb24b31b790fcf13218a97c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.861887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e052d56beb24b31b790fcf13218a97c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:43.864008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:43.876859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:43.909024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e052d56beb24b31b790fcf13218a97c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:43.916388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e052d56beb24b31b790fcf13218a97c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:43.917021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e052d56beb24b31b790fcf13218a97c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:43.929354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e052d56beb24b31b790fcf13218a97c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:43.936241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e052d56beb24b31b790fcf13218a97c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:43.942039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1306/2574] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:43 2022] DELETE /identity/v3/users/2e052d56beb24b31b790fcf13218a97c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:43.946507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:43.946798 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:43.947076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:43.966291 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:43.967552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:44.025439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1269/2575] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:44.035129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:44.037079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:44.095518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ec1b9-a34a-48a0-bb4e-aa8afae412fc admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:44.099738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:44.100351 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:44.100638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:44.100916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:44.110344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:44.111713 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:44.126283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1307/2576] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:44.414245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:44.415880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:44.431436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927c6eb-aed6-4816-9475-793ff3b014b6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:44.437280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:44.437978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:44.438260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:44.438528 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] PATH_INFO: `/v3/projects/fd11a87b20aa4b4e88d3f90a03a93bdb` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:44.439738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd11a87b20aa4b4e88d3f90a03a93bdb)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:44.441684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:44.512206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd11a87b20aa4b4e88d3f90a03a93bdb', 'request_id': 'req-ac7a28ad-233c-475c-bb84-59d913cc19fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.520429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd11a87b20aa4b4e88d3f90a03a93bdb', 'request_id': 'req-ac7a28ad-233c-475c-bb84-59d913cc19fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.526507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd11a87b20aa4b4e88d3f90a03a93bdb', 'request_id': 'req-ac7a28ad-233c-475c-bb84-59d913cc19fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.539508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] The token cache is being invalidate because project fd11a87b20aa4b4e88d3f90a03a93bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:44.539802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.540465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.542016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1270/2577] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:44 2022] DELETE /identity/v3/projects/fd11a87b20aa4b4e88d3f90a03a93bdb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:44.546112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:44.557347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b16f2-654f-46b6-874a-ced32049c718 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:44.617117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:44.618381 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:44.618909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:44.619409 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] PATH_INFO: `/v3/users/232b28f39fff49c6b07dbd377cb1ad2c` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:44.621419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=232b28f39fff49c6b07dbd377cb1ad2c)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:44.624283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:44.667698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:44.679679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '232b28f39fff49c6b07dbd377cb1ad2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.691795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '232b28f39fff49c6b07dbd377cb1ad2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.694013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '232b28f39fff49c6b07dbd377cb1ad2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.708540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '232b28f39fff49c6b07dbd377cb1ad2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.726411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4e80f6b5-c2f8-4df8-a9d9-a00258bb2611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '232b28f39fff49c6b07dbd377cb1ad2c'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:44.735489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1308/2578] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:44 2022] DELETE /identity/v3/users/232b28f39fff49c6b07dbd377cb1ad2c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:45.042931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.045641 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:45.068216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7a28ad-233c-475c-bb84-59d913cc19fe admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.140760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.141736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.142119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.142459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] PATH_INFO: `/v3/projects/2132fc3eec094f8992e84ac2b168d2ac` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.143707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2132fc3eec094f8992e84ac2b168d2ac)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.146447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.174062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:45.202903 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2132fc3eec094f8992e84ac2b168d2ac', 'request_id': 'req-1ed41b95-9ab5-4d87-800c-e6600dd42768'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:45.213452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2132fc3eec094f8992e84ac2b168d2ac', 'request_id': 'req-1ed41b95-9ab5-4d87-800c-e6600dd42768'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:45.223249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2132fc3eec094f8992e84ac2b168d2ac', 'request_id': 'req-1ed41b95-9ab5-4d87-800c-e6600dd42768'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:45.243019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] The token cache is being invalidate because project 2132fc3eec094f8992e84ac2b168d2ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:45.243321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:45.244028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1ed41b95-9ab5-4d87-800c-e6600dd42768 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:45.245518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1271/2579] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:45 2022] DELETE /identity/v3/projects/2132fc3eec094f8992e84ac2b168d2ac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:45.252928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.253390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.253584 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.284407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:45.285747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:45.363245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1309/2580] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:45.371661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.372009 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.372333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.395153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:45.397194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:45.405983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1272/2581] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:45.410397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.421213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b868363-789b-45a9-9b02-b2b56cee3ebe None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.426815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.428286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.428286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.428286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.428858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:45.429236 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.431003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.449403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1310/2582] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 16 01:59:45.451153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.472463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109450c-524f-4e2f-a7e5-6ae245f31d1d None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.488212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.488835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.489154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.489428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.490729 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.495789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.566927 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1273/2583] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:45 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:45.571611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.593529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65218af-0a1f-4f72-b95c-aa070b1ab299 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.709559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.710288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.710553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.710827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.711472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.713472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.767611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1311/2584] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:45 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:45.772468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.794832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35011e-a36f-49c1-8418-42cc002ab760 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.817243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.819513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.819907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.820416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.821579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.824311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3227280-4e00-4d37-a0b8-3ba822a8281e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.855153 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1274/2585] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:45.858950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.877596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc242a1-2a07-4c1a-b64c-0e765b5095ea admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.888039 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.889038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.889328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.889739 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.891053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:45.894773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:45.927163 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1312/2586] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:45.931457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:45.932060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee19-f3a2-48ab-9967-f10e43f71071 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.932357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee19-f3a2-48ab-9967-f10e43f71071 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.932742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522ee19-f3a2-48ab-9967-f10e43f71071 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.934195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1275/2587] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 16 01:59:45.944687 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.944974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.945268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.955538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da70f8b-bc11-4293-8235-528defc45ef7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:45.964203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:45.965918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:45.966451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:45.966917 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] PATH_INFO: `/v3/projects/76d531e9d8b1444cac7654cff6e86bb9/users/7cb184cebecd4ccab262a736de22338f/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:45.973239 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:45.976086 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.002234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d531e9d8b1444cac7654cff6e86bb9, user_id=7cb184cebecd4ccab262a736de22338f, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.005663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7da07d-03a3-4425-909d-5b952b1d7afb admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.008122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:46.026711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1313/2588] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:45 2022] PUT /identity/v3/projects/76d531e9d8b1444cac7654cff6e86bb9/users/7cb184cebecd4ccab262a736de22338f/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:46.038761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.039041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.039395 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.076911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] MFA Rules not processed for user `7cb184cebecd4ccab262a736de22338f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:46.078227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.101014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1276/2589] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:59:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:46.117695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.119413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.177805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1314/2590] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:46.182949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.198206 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762beef2-6c24-4385-b6c5-01f5c617989b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.213388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:46.251925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a986b7-9e06-4dd5-a83d-e06fae45f287 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.256862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.257502 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.257618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.257883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.258050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.258851 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.258977 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.259059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.261330 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.262121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.294816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1315/2591] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:46.298927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.333826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.335301 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.346256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1277/2592] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:46.362560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611cf1-9304-42e5-9020-f13d2ffc0612 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.368336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.368946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.369228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.369505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.370174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.372066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435649f2-7b11-4973-af06-04c5f19a7b6c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.388422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:46.400234 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.400759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1316/2593] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/users => generated 298 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:46.412409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2e115-fb42-410f-a468-3244808a6a18 service glance] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.420001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8649-99d1-4396-88b3-8d0864ae7453 None None] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.421107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8649-99d1-4396-88b3-8d0864ae7453 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.421389 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e8649-99d1-4396-88b3-8d0864ae7453 None None] PATH_INFO: `/` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.422984 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1317/2594] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:59:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:59:46.426496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.429649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.430397 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.430863 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.431039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.431184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.431418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.431696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.435354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.446849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1278/2595] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:46.451007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.454049 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] MFA Rules not processed for user `ba3e762164ac406bbdd85ff1185c53c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:46.455241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.461988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f19fff-e053-42ba-898b-9c3346bca59f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.466632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.467280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.467580 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.467857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] PATH_INFO: `/v3/projects/dc6a543e91514e0784afbfdc05b8de7b/users/dc3583f876ae4f81b283c089301269f2/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.483208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6a543e91514e0784afbfdc05b8de7b, user_id=dc3583f876ae4f81b283c089301269f2, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.485844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.500541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1279/2596] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:46 2022] PUT /identity/v3/projects/dc6a543e91514e0784afbfdc05b8de7b/users/dc3583f876ae4f81b283c089301269f2/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:46.504433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.508428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1318/2597] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:46.521747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.523147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.533362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad371-4749-4ddd-86cf-b7412d2e061b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.567993 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1bf59-4d05-4983-8d15-7bfb2c3620ff admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.572872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.573485 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.573760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.574132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.574774 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.576396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.583297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.583911 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.584195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.584467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.586880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1280/2598] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:46.591089 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.594857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.596289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073981f-740b-4078-8224-a83829025aaf service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.601278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aae2e0-4dec-4f38-9ce2-94f470998db9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.605001 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1319/2599] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:46.606144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.606792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.607076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.607385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] PATH_INFO: `/v3/projects/dc6a543e91514e0784afbfdc05b8de7b/users/dc3583f876ae4f81b283c089301269f2/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.609412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6a543e91514e0784afbfdc05b8de7b, user_id=dc3583f876ae4f81b283c089301269f2, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.612093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a36c5a-b8a8-4692-9dbd-330c125fec3c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.622584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1281/2600] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:46 2022] PUT /identity/v3/projects/dc6a543e91514e0784afbfdc05b8de7b/users/dc3583f876ae4f81b283c089301269f2/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:46.633332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.633831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.634160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.664586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] MFA Rules not processed for user `dc3583f876ae4f81b283c089301269f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:46.665999 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.691282 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0714-de55-49e7-b507-a3d36a65ba69 None None] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.691666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0714-de55-49e7-b507-a3d36a65ba69 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.692005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa0714-de55-49e7-b507-a3d36a65ba69 None None] PATH_INFO: `/` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.693647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1282/2601] 10.222.0.33 () {54 vars in 921 bytes} [Fri Sep 16 01:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 16 01:59:46.699036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.699398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.699748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.715483 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:46.721713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] MFA Rules not processed for user `6e5607c5bb0f43cc9e79e6e0351077a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:46.724058 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.745633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1320/2602] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:46.756700 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.758100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.795061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1283/2603] 10.222.0.33 () {58 vars in 1018 bytes} [Fri Sep 16 01:59:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:46.799974 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=100 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:46.805934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.818495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ef24b0-76a7-4589-b8d5-38cc9dcbf9be None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.822051 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.822656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.822936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.823210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.831969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.834024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.843719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1321/2604] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:46.862954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f523e6e2-8067-4cc3-9967-cef162a75931 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.866883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.867695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.867978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.868252 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:46.881077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:46.882551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:46.896054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1284/2605] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:46.948507 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.956169 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:46.957154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4db9707-926d-4401-991a-60afd1e52d51 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:46.958619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:46.961816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:46.962439 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:46.962717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:46.962990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:47.045388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97627dbe-1eb6-4841-9e27-806945553e98 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:47.051126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:47.052302 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:47.052583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:47.052859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:47.054780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:47.068498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:47.070229 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:47.084056 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1285/2606] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:47.171812 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:47.174750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea94d24a-5249-4147-bc92-cf7ecfe88227 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:47.189694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1322/2607] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:47.252872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:47.255069 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:47.305679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:47.352651 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0e03-b9df-45c2-8147-922347e107fb service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:47.358723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:47.359806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:47.359806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:47.360098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] PATH_INFO: `/v3/users/52d7dbbcff0f489ba311cab525dd3869` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:47.361436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52d7dbbcff0f489ba311cab525dd3869)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:47.363607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:47.417638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52d7dbbcff0f489ba311cab525dd3869'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:47.424978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52d7dbbcff0f489ba311cab525dd3869'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:47.439699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52d7dbbcff0f489ba311cab525dd3869'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:47.440401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52d7dbbcff0f489ba311cab525dd3869'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:47.448595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52d7dbbcff0f489ba311cab525dd3869'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:47.455006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1286/2608] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:47 2022] DELETE /identity/v3/users/52d7dbbcff0f489ba311cab525dd3869 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:47.460117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:47.460668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:47.460787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:47.482790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:47.484368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:47.606667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1323/2609] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:47.615067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:47.616701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:47.676430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045739cf-6ff8-47b7-8860-3c4598b00515 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:47.680152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:47.680769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:47.681048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:47.681323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:47.690666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:47.692635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:47.702437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1287/2610] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:47.972462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:47.979257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:47.992944 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454f3f0-d6ed-4f0f-9cac-8672a52633d8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:48.003971 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:48.004783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:48.004995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:48.005283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] PATH_INFO: `/v3/projects/5a0dd6d05c8847068977b8bbc616ace8` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:48.007125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0dd6d05c8847068977b8bbc616ace8)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:48.010094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:48.059929 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0dd6d05c8847068977b8bbc616ace8', 'request_id': 'req-e24480a9-0125-4ee5-86ac-b4ae829801ab'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.070260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0dd6d05c8847068977b8bbc616ace8', 'request_id': 'req-e24480a9-0125-4ee5-86ac-b4ae829801ab'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.076745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0dd6d05c8847068977b8bbc616ace8', 'request_id': 'req-e24480a9-0125-4ee5-86ac-b4ae829801ab'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.085500 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:48.091448 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] The token cache is being invalidate because project 5a0dd6d05c8847068977b8bbc616ace8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:48.091951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.092988 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.095543 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1324/2611] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:47 2022] DELETE /identity/v3/projects/5a0dd6d05c8847068977b8bbc616ace8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:48.099534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:48.109331 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e3831-d9e6-44f1-8ba8-d7f1a94671a2 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:48.159462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:48.170649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:48.171461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:48.171750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:48.172033 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] PATH_INFO: `/v3/users/bb20839d11ef450ea80e5ebf3170f704` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:48.173335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb20839d11ef450ea80e5ebf3170f704)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:48.176187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:48.234842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb20839d11ef450ea80e5ebf3170f704'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.245208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb20839d11ef450ea80e5ebf3170f704'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.264907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb20839d11ef450ea80e5ebf3170f704'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.265776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb20839d11ef450ea80e5ebf3170f704'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.282018 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-353f4cf4-9271-4bb8-89a5-6180e99530dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb20839d11ef450ea80e5ebf3170f704'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.289832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1288/2612] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:48 2022] DELETE /identity/v3/users/bb20839d11ef450ea80e5ebf3170f704 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:48.685154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:48.688190 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:48.706272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24480a9-0125-4ee5-86ac-b4ae829801ab admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:48.789557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:48.790535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:48.790879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:48.791320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] PATH_INFO: `/v3/projects/d5a05abb92e24b66a961a9d83c26e12e` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:48.792554 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a05abb92e24b66a961a9d83c26e12e)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:48.794723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:48.807519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:48.808023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:48.808130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:48.831372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:48.832637 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:48.853882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a05abb92e24b66a961a9d83c26e12e', 'request_id': 'req-bd2e1de4-ef6c-4d1f-90a2-12857757c797'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.862536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a05abb92e24b66a961a9d83c26e12e', 'request_id': 'req-bd2e1de4-ef6c-4d1f-90a2-12857757c797'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.870733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a05abb92e24b66a961a9d83c26e12e', 'request_id': 'req-bd2e1de4-ef6c-4d1f-90a2-12857757c797'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.884056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] The token cache is being invalidate because project d5a05abb92e24b66a961a9d83c26e12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:48.884691 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.885528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:48.887349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1325/2613] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:48 2022] DELETE /identity/v3/projects/d5a05abb92e24b66a961a9d83c26e12e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:48.898055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:48.898055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:48.915982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1289/2614] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 01:59:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:48.928959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:48.930367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:48.960358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e1de4-ef6c-4d1f-90a2-12857757c797 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:48.970873 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:48.971603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:48.971896 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:48.972176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] PATH_INFO: `/v3/users/cc649e2bf5c547d1823bde7ad9246e4d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:48.973433 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc649e2bf5c547d1823bde7ad9246e4d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:48.975407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:49.012378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:49.015433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31616dd8-5ce7-4a54-b25b-d39413a2b306 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:49.023007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:49.023624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.023901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.024178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.030415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc649e2bf5c547d1823bde7ad9246e4d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.034701 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:49.037293 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:49.042533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc649e2bf5c547d1823bde7ad9246e4d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.043287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc649e2bf5c547d1823bde7ad9246e4d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.047052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1290/2615] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 01:59:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 01:59:49.064061 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc649e2bf5c547d1823bde7ad9246e4d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.072250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc649e2bf5c547d1823bde7ad9246e4d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.078861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1326/2616] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:48 2022] DELETE /identity/v3/users/cc649e2bf5c547d1823bde7ad9246e4d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:49.361901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:49.365219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.380902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64578b94-5631-4eff-b72a-51ce5a5cb44c service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:49.385383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:49.467279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:49.469126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.503594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:49.504367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.504766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.505105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] PATH_INFO: `/v3/users/383af32f98ff494d85e08e40adeba358` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.506636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] RBAC: Authorizing `identity:delete_user(user_id=383af32f98ff494d85e08e40adeba358)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:49.508888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:49.587154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '383af32f98ff494d85e08e40adeba358'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.593741 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f670e80f-c8d6-4119-b94e-a3477d8c96fc admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:49.602760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:49.603006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '383af32f98ff494d85e08e40adeba358'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.603956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.604503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.604885 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] PATH_INFO: `/v3/projects/11b855c59d0848f1851f777bf6c76d04` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.606456 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b855c59d0848f1851f777bf6c76d04)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:49.609123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:49.659734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '383af32f98ff494d85e08e40adeba358'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.660475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '383af32f98ff494d85e08e40adeba358'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.680053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b855c59d0848f1851f777bf6c76d04', 'request_id': 'req-ff48b232-9774-4fb8-88fb-1c45d31325ff'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.690595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-8e605eab-2690-4475-920b-b69f40001773 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '383af32f98ff494d85e08e40adeba358'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.691435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b855c59d0848f1851f777bf6c76d04', 'request_id': 'req-ff48b232-9774-4fb8-88fb-1c45d31325ff'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.699621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b855c59d0848f1851f777bf6c76d04', 'request_id': 'req-ff48b232-9774-4fb8-88fb-1c45d31325ff'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.709601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1291/2617] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:49 2022] DELETE /identity/v3/users/383af32f98ff494d85e08e40adeba358 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:49.714272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.714671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.716983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.724151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] The token cache is being invalidate because project 11b855c59d0848f1851f777bf6c76d04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:49.726309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.728830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-ff48b232-9774-4fb8-88fb-1c45d31325ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:49.734335 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1327/2618] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:49 2022] DELETE /identity/v3/projects/11b855c59d0848f1851f777bf6c76d04 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:49.740109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b609-cd85-4803-b0f9-04e8889c40f0 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.740518 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b609-cd85-4803-b0f9-04e8889c40f0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.740895 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992b609-cd85-4803-b0f9-04e8889c40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.765140 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:49.771437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.784838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b992b609-cd85-4803-b0f9-04e8889c40f0 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:49.787319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b992b609-cd85-4803-b0f9-04e8889c40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.835598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:49.897570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1328/2620] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:49.905356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:49.905559 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1292/2620] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:49.906028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:49.906028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:49.919083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:49.921114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.968598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:49.974498 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:49.975804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:49.992892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1329/2621] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:49.994625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:49.998461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.018148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca9bbd1-855e-4606-9163-0e2a9b34ad67 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.024151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.024790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.025146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.025419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] PATH_INFO: `/v3/users/7cb184cebecd4ccab262a736de22338f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.026839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cb184cebecd4ccab262a736de22338f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.029082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.029385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5474251b-f3f1-42f8-b8c6-5c79ba8e2715 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.034980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.036409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.036985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.037445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.053378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.055488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.083236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1293/2622] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:50.086150 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.107902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b640b-62b7-4609-9dd3-2df7183bfe2a service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.120558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.121328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cb184cebecd4ccab262a736de22338f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.121788 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.122342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.122923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.123848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:50.124399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.126573 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.131733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cb184cebecd4ccab262a736de22338f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.132867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cb184cebecd4ccab262a736de22338f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.155419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1294/2623] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:50.160104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cb184cebecd4ccab262a736de22338f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.165988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.171987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.173771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-47967b7a-002f-4053-b783-77b5b3706276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cb184cebecd4ccab262a736de22338f'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.182053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1330/2624] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:49 2022] DELETE /identity/v3/users/7cb184cebecd4ccab262a736de22338f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:50.187006 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.187411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.187913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.207032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b71d2-bcfd-4c63-b350-4ce967725617 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.226578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:50.229642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.333192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1331/2625] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:50.338111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.338111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.338111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.338611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.338912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.340855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.345172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.347264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.391747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1295/2626] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:50 2022] POST /identity/v3/projects => generated 371 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:50.396476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.439452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:50.452981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe6ef6-7654-40ff-94d6-3cbde38e92f0 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.545526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee35a-5551-4c82-be64-afba2a33e06d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.562121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.562892 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.563180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.563456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.564103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.566381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.570080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.571293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.571813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.572294 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.593137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.595109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.609212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1332/2627] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:50.612527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1296/2628] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:50 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:50.613903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.636119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152e818d-3026-44b2-9393-04649c82fd72 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.653743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.666239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.666827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.667318 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.668889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.671831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.686696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.689185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.692862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1333/2629] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:50.699722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.716976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80b4e6-6935-4a2a-bc2f-262f447b12f0 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.725143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.725949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.726306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.726810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.727493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.729897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.740024 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c87e03-4fae-4d11-a6fb-36c6bdfe81dc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.746730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.748126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.748408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.748835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] PATH_INFO: `/v3/projects/e60b395f998b4c82af0e12cb9bbf65b8` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.751772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e60b395f998b4c82af0e12cb9bbf65b8)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.753933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1334/2630] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:50.754128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.758786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:50.785665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d05d3-a182-45cb-b9b9-5eb037a7f360 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:50.795601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:50.796527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.796814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.797109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] PATH_INFO: `/v3/projects/11b37406c6994be0b5e6241dd2dbda9f/users/f3d6b85899d4402db6611333605e812b/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.804098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:50.818347 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b37406c6994be0b5e6241dd2dbda9f, user_id=f3d6b85899d4402db6611333605e812b, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:50.822314 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79d430-57b4-4f98-a1d8-83875830c379 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:50.845071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e60b395f998b4c82af0e12cb9bbf65b8', 'request_id': 'req-dddaeee5-a90c-4294-97ac-14a92540c3fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.850877 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1335/2631] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:50 2022] PUT /identity/v3/projects/11b37406c6994be0b5e6241dd2dbda9f/users/f3d6b85899d4402db6611333605e812b/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:50.853721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.854353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.854792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.864713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e60b395f998b4c82af0e12cb9bbf65b8', 'request_id': 'req-dddaeee5-a90c-4294-97ac-14a92540c3fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.878929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e60b395f998b4c82af0e12cb9bbf65b8', 'request_id': 'req-dddaeee5-a90c-4294-97ac-14a92540c3fe'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.890304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:50.893203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:50.902753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] The token cache is being invalidate because project e60b395f998b4c82af0e12cb9bbf65b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:50.903669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.904388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-dddaeee5-a90c-4294-97ac-14a92540c3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:50.906510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1297/2632] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:50 2022] DELETE /identity/v3/projects/e60b395f998b4c82af0e12cb9bbf65b8 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:50.912241 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9038c-2658-43cb-964b-3e25ac75d173 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:50.912719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9038c-2658-43cb-964b-3e25ac75d173 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:50.913092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b9038c-2658-43cb-964b-3e25ac75d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:50.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b9b9038c-2658-43cb-964b-3e25ac75d173 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:50.943004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b9b9038c-2658-43cb-964b-3e25ac75d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.027965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1336/2633] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:51.046182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.047903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.075820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1298/2634] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:51.086000 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609603-c683-4436-a615-1781469a2ccb None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.086478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609603-c683-4436-a615-1781469a2ccb None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.087178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6609603-c683-4436-a615-1781469a2ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.138231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f6609603-c683-4436-a615-1781469a2ccb None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:51.139211 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f6609603-c683-4436-a615-1781469a2ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.144909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a4b0e-0881-48e3-b3c8-655976399719 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.153631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.154279 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.154560 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.154833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.158424 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1299/2635] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:51.162707 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609603-c683-4436-a615-1781469a2ccb None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.172470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.174188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.188128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6609603-c683-4436-a615-1781469a2ccb None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.204954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.205508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.205962 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.206243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.207053 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:51.207372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.214699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.214979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1337/2636] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:51.239994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1300/2637] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:51.244686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.254224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:51.258962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33571f8-8ee1-4dd1-b327-666fc72d198f service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.279522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.284288 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.299298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.300950 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.302101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.302380 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.303070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.308223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.321677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee9185e-303b-4640-8a6d-0be8c98f74a0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.338399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.339061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.339344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.341654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] PATH_INFO: `/v3/projects/76d531e9d8b1444cac7654cff6e86bb9` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.344129 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d531e9d8b1444cac7654cff6e86bb9)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.346144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.391882 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1338/2638] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:51 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:51.396470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.461115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d531e9d8b1444cac7654cff6e86bb9', 'request_id': 'req-14a030c3-a833-4593-8778-41c03028bfc4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.472396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d531e9d8b1444cac7654cff6e86bb9', 'request_id': 'req-14a030c3-a833-4593-8778-41c03028bfc4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.481260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d531e9d8b1444cac7654cff6e86bb9', 'request_id': 'req-14a030c3-a833-4593-8778-41c03028bfc4'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.508174 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] The token cache is being invalidate because project 76d531e9d8b1444cac7654cff6e86bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:51.508997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.512499 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.515506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1301/2639] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:51 2022] DELETE /identity/v3/projects/76d531e9d8b1444cac7654cff6e86bb9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:51.519844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.523985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.563010 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e15e6-21f6-4edc-bd93-6f4b5392f322 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.587505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:51.692450 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a030c3-a833-4593-8778-41c03028bfc4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.696426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.698154 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.698748 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.722795 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.724272 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.726261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.729952 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.730957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.731711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.732207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] PATH_INFO: `/v3/users/dc3583f876ae4f81b283c089301269f2` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.739733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3583f876ae4f81b283c089301269f2)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.745020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.762597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1339/2640] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:51 2022] POST /identity/v3/users => generated 287 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:51.772549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.778445 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:51.826031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea585d-e5c2-4052-a825-cd1f9533b4ee admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.835203 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.837228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.837899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.838856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.840405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.844734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.876907 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1340/2641] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:51.881228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.906383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d4ee73-017e-4f53-ac38-4c4878093f59 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.913308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.914040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.914436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.914714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.915616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:51.915968 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3583f876ae4f81b283c089301269f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.917582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:51.933124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1341/2642] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:51.935395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3583f876ae4f81b283c089301269f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.937716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:51.952327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3583f876ae4f81b283c089301269f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.953525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3583f876ae4f81b283c089301269f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.961235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6dd6-912c-4a00-9ad8-7cec096b7a37 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:51.966299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76ac0b6a-685e-425a-8946-777b48c5b270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3583f876ae4f81b283c089301269f2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:51.970744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:51.971422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:51.971722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:51.972027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] PATH_INFO: `/v3/projects/50ef9d6f3f1f4df8a6e0643338dc80ec/users/0c902163ebcd49f88ce85ae9eecc8bcc/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:51.975243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1302/2643] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:51 2022] DELETE /identity/v3/users/dc3583f876ae4f81b283c089301269f2 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:52.004013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=50ef9d6f3f1f4df8a6e0643338dc80ec, user_id=0c902163ebcd49f88ce85ae9eecc8bcc, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:52.008804 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:52.047884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1342/2644] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:51 2022] PUT /identity/v3/projects/50ef9d6f3f1f4df8a6e0643338dc80ec/users/0c902163ebcd49f88ce85ae9eecc8bcc/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:52.050718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc391-4070-493d-9f5c-66a6cde1c9a7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.051007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc391-4070-493d-9f5c-66a6cde1c9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.051878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cc391-4070-493d-9f5c-66a6cde1c9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.109454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-1b0cc391-4070-493d-9f5c-66a6cde1c9a7 None None] MFA Rules not processed for user `0c902163ebcd49f88ce85ae9eecc8bcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:52.110269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1b0cc391-4070-493d-9f5c-66a6cde1c9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.220638 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1303/2645] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:52.225747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.227732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.308326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:52.398233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7a528-b8dc-4d93-967e-5fd6c1cf8f3d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:52.404644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:52.405275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.405582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.405969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.406594 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:52.408562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:52.469688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.470093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.470693 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.499580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1343/2646] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:52 2022] POST /identity/v3/projects => generated 373 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:52.500781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.541784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] MFA Rules not processed for user `f3d6b85899d4402db6611333605e812b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:52.543318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.579076 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:52.661337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c324bc2-e7de-4e9e-8554-b5c7b2933970 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:52.674883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:52.677397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.678653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.679468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.682303 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:52.684892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:52.724103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1304/2647] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 01:59:52.724103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.724317 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1344/2648] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:52 2022] POST /identity/v3/users => generated 293 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:52.730064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.731675 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.745593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4010cc-0390-429f-ba7e-38875f3f52c1 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:52.761093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171500fa-f57c-42dd-add4-65e3958f3542 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:52.764229 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:52.764865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.765153 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.765848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.767206 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:52.770281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:52.772419 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:52.773257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.773610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.773983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] PATH_INFO: `/v3/projects/dc6a543e91514e0784afbfdc05b8de7b` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.775226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6a543e91514e0784afbfdc05b8de7b)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:52.777382 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:52.788656 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1345/2649] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:52 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:52.790271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.792020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.853283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6a543e91514e0784afbfdc05b8de7b', 'request_id': 'req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:52.866488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6a543e91514e0784afbfdc05b8de7b', 'request_id': 'req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:52.877054 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6a543e91514e0784afbfdc05b8de7b', 'request_id': 'req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:52.897899 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] The token cache is being invalidate because project dc6a543e91514e0784afbfdc05b8de7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:52.898437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:52.899517 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:52.902633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1305/2650] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:52 2022] DELETE /identity/v3/projects/dc6a543e91514e0784afbfdc05b8de7b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:52.904038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:52.906925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.912945 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1eb54-89d8-4083-a281-579c2b4eefae admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:52.978976 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:52.980176 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:52.980626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:52.981068 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:52.984845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:52.995299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:53.023845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf68ad-43c8-462b-a2aa-d1a4e123fc30 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:53.030160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:53.031138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:53.031781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:53.032221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] PATH_INFO: `/v3/projects/f1028d67776a4e9aabfd801913ccc3ab/users/673e36d3c9c34d0caa3a69cd29c36a15/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:53.060405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1028d67776a4e9aabfd801913ccc3ab, user_id=673e36d3c9c34d0caa3a69cd29c36a15, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:53.064948 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:53.089136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1306/2651] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:52 2022] PUT /identity/v3/projects/f1028d67776a4e9aabfd801913ccc3ab/users/673e36d3c9c34d0caa3a69cd29c36a15/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:53.094771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:53.140044 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:53.154858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:53.156315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:53.180050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1346/2652] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:53.203093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b57a-41b7-48a0-b5e7-98edfb534406 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:53.209476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:53.210842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:53.211208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:53.211690 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:53.212554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:53.214835 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ca014-e819-4b8f-b95f-d8a977b15169 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:53.235145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1307/2653] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:53.236088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:53.249506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbe9c-767c-4073-b5d9-aa7fcdd3e45f service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:53.255892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:53.256706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:53.257083 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:53.257370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] PATH_INFO: `/v3/projects/f1028d67776a4e9aabfd801913ccc3ab/users/673e36d3c9c34d0caa3a69cd29c36a15/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:53.259623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1028d67776a4e9aabfd801913ccc3ab, user_id=673e36d3c9c34d0caa3a69cd29c36a15, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:53.262324 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:53.277449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1347/2654] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:53 2022] PUT /identity/v3/projects/f1028d67776a4e9aabfd801913ccc3ab/users/673e36d3c9c34d0caa3a69cd29c36a15/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:53.287905 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:53.288453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:53.288898 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:53.328834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] MFA Rules not processed for user `673e36d3c9c34d0caa3a69cd29c36a15`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:53.330793 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:53.445307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1308/2655] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:53.456734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:53.459577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:53.574455 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099fee9-2f37-4355-8d22-da96a00c6d03 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:53.586970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:53.588062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:53.588342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:53.588610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:53.618282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:53.619813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55387f50-544b-4864-a289-269e93b94bee service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:53.641768 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1348/2656] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:54.173258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:54.242379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb58a3-884a-418a-8aed-c5db106928fa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:54.248200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:54.248857 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:54.249141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:54.249415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] PATH_INFO: `/v3/users/0c902163ebcd49f88ce85ae9eecc8bcc` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:54.250582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c902163ebcd49f88ce85ae9eecc8bcc)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:54.252614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:54.310307 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:54.312299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c902163ebcd49f88ce85ae9eecc8bcc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:54.323256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c902163ebcd49f88ce85ae9eecc8bcc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:54.340531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c902163ebcd49f88ce85ae9eecc8bcc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:54.341566 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c902163ebcd49f88ce85ae9eecc8bcc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:54.348833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c902163ebcd49f88ce85ae9eecc8bcc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:54.354943 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1309/2657] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:54 2022] DELETE /identity/v3/users/0c902163ebcd49f88ce85ae9eecc8bcc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:54.359526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afc00-7269-463a-93c2-eede48b69783 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:54.360175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afc00-7269-463a-93c2-eede48b69783 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:54.360175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996afc00-7269-463a-93c2-eede48b69783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:54.379838 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-996afc00-7269-463a-93c2-eede48b69783 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:54.381275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-996afc00-7269-463a-93c2-eede48b69783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:54.446385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1349/2658] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:54.456068 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:54.457522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:54.524318 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e08bab-0368-4862-b2f0-abc35bc03da2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:54.527924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:54.528532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:54.528806 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:54.529090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:54.539177 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:54.540920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:54.553536 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1310/2659] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 01:59:54.760355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:54.760692 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:54.760916 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:54.791894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] MFA Rules not processed for user `f3d6b85899d4402db6611333605e812b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:54.793633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:54.828346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:54.871017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1350/2660] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:54.931376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:54.934255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:54.960875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a366a6f-4701-4073-ba60-9f5b2ced9978 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:54.967916 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:54.968772 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:54.969040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:54.969399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] PATH_INFO: `/v3/projects/50ef9d6f3f1f4df8a6e0643338dc80ec` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:54.970739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50ef9d6f3f1f4df8a6e0643338dc80ec)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:54.973908 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:55.074856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50ef9d6f3f1f4df8a6e0643338dc80ec', 'request_id': 'req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.090202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50ef9d6f3f1f4df8a6e0643338dc80ec', 'request_id': 'req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.099136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50ef9d6f3f1f4df8a6e0643338dc80ec', 'request_id': 'req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.115816 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] The token cache is being invalidate because project 50ef9d6f3f1f4df8a6e0643338dc80ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:55.116292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.117103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.119599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1311/2661] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:54 2022] DELETE /identity/v3/projects/50ef9d6f3f1f4df8a6e0643338dc80ec => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:55.123473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:55.151091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd24f02-d854-41ae-a02e-4dc7b86f6d59 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:55.158090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:55.159520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:55.267498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:55.270461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:55.270461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:55.270461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:55.270461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] PATH_INFO: `/v3/users/673e36d3c9c34d0caa3a69cd29c36a15` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:55.281104 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf4fff-ec8e-4d62-9fa3-09912d8d5288 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:55.285193 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] RBAC: Authorizing `identity:delete_user(user_id=673e36d3c9c34d0caa3a69cd29c36a15)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:55.287328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:55.292616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:55.293426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:55.294505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:55.294888 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:55.303929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:55.315443 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:55.317699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:55.335604 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1312/2662] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 01:59:55.388581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '673e36d3c9c34d0caa3a69cd29c36a15'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.398342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '673e36d3c9c34d0caa3a69cd29c36a15'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.399111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '673e36d3c9c34d0caa3a69cd29c36a15'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.416718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '673e36d3c9c34d0caa3a69cd29c36a15'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.425179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-49c8580e-6021-4a32-ad4a-f18668efa96e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '673e36d3c9c34d0caa3a69cd29c36a15'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:55.433258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1351/2663] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 01:59:55 2022] DELETE /identity/v3/users/673e36d3c9c34d0caa3a69cd29c36a15 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:55.792500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:55.794332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:55.838011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0afd3-ce9e-4300-944d-ab2aca2cb724 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:55.972261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:55.973558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:55.973967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:55.974340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] PATH_INFO: `/v3/projects/f1028d67776a4e9aabfd801913ccc3ab` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:55.975836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1028d67776a4e9aabfd801913ccc3ab)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:55.978277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.080039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1028d67776a4e9aabfd801913ccc3ab', 'request_id': 'req-bccd1161-efa8-47c2-bfe4-f92c53b94853'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:56.088568 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1028d67776a4e9aabfd801913ccc3ab', 'request_id': 'req-bccd1161-efa8-47c2-bfe4-f92c53b94853'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:56.095920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1028d67776a4e9aabfd801913ccc3ab', 'request_id': 'req-bccd1161-efa8-47c2-bfe4-f92c53b94853'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:56.112657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] The token cache is being invalidate because project f1028d67776a4e9aabfd801913ccc3ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 01:59:56.113095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:56.114575 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bccd1161-efa8-47c2-bfe4-f92c53b94853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 01:59:56.116853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1313/2664] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 01:59:55 2022] DELETE /identity/v3/projects/f1028d67776a4e9aabfd801913ccc3ab => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:56.122098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.122396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.122821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.152301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:56.153537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:56.236839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:56.257711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1352/2665] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:56.259633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.260090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.260526 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.287186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:56.288458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:56.304891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1314/2666] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:56.306698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.329418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb337184-180b-4c66-9d09-c3402305d5d3 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.349434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.350302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.350609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.350951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.351853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 01:59:56.352119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.370762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.402390 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1353/2667] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 01:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 01:59:56.406860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.419065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f61a3-f172-4795-8601-1c34204ed267 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.424688 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.425438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.425826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.426844 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.427755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.429929 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.467545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1315/2668] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:56.472746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.483766 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37b739-0fee-44c9-b352-910d1b194526 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.560630 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.561341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.561733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.562110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.562756 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.564862 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.609900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1354/2669] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:56.614062 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.625134 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b9606-3671-4c5b-a11c-d71413ce37cf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.630549 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.631175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.631457 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.631733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.632373 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.634026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.644327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1316/2670] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:56.649070 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.659632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4772d9ac-2e57-468f-82d9-7382e15d8c00 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.665903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.665903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.665903 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.666295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.666839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.668499 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d167b2f-112c-4db5-8a99-993c49e35948 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.682164 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1355/2671] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:56.687378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.700019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72cc51e-3ac4-4d76-9668-ac0f78bfc0d8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.704919 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.705594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.705913 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.706198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] PATH_INFO: `/v3/projects/c21601270aab46e9bbe05a6d945c479c/users/97085c33ec85447e8d20f06af4fcce45/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.722094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c21601270aab46e9bbe05a6d945c479c, user_id=97085c33ec85447e8d20f06af4fcce45, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.724834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.739408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1317/2672] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:56 2022] PUT /identity/v3/projects/c21601270aab46e9bbe05a6d945c479c/users/97085c33ec85447e8d20f06af4fcce45/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 01:59:56.749787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.750112 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.750398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.781816 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] MFA Rules not processed for user `97085c33ec85447e8d20f06af4fcce45`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:56.783110 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:56.857968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1356/2673] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:56.862660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.883629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:56.937717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5926d7b-4bb2-401f-9f40-fb4086cda221 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:56.942869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:56.943531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:56.943814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:56.944085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:56.944716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:56.946659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:56.974680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1318/2674] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/projects => generated 375 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 01:59:56.978728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:56.990673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1706f32-645a-459d-8ce2-afdca08a869c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.042998 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:57.051447 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.052056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.052360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.052633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.053271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.055192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.077232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1357/2675] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 01:59:56 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 01:59:57.081381 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:57.092258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762807ab-2962-46ef-9898-566f5598006e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.096778 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.097370 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.097649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.098607 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.099245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.100830 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.111052 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1319/2676] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 01:59:57.115787 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:57.125415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c8fe2-c523-4710-8045-f4c9a4d37f05 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.129975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.130616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.130900 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.131178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] PATH_INFO: `/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079/users/c978bcb82438457086abbdc48254d8a3/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.146115 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d483a1d7ab04ebbb2d8a0c4e1a0e079, user_id=c978bcb82438457086abbdc48254d8a3, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.148751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.161772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1358/2677] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:57 2022] PUT /identity/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079/users/c978bcb82438457086abbdc48254d8a3/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:57.165659 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:57.175541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f620f-dac8-4f98-9e82-7ca73513c602 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.234890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.235491 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.235773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.236049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.236678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.238335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e67f0-f6aa-46bd-84c4-23ac38031d6f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.247790 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1320/2678] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 01:59:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 01:59:57.251943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:57.262779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f38b10-63ac-4fcc-82de-4998f409a15c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.267370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.268024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.268305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.268581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] PATH_INFO: `/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079/users/c978bcb82438457086abbdc48254d8a3/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.271059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d483a1d7ab04ebbb2d8a0c4e1a0e079, user_id=c978bcb82438457086abbdc48254d8a3, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.273668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.283883 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1359/2679] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 01:59:57 2022] PUT /identity/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079/users/c978bcb82438457086abbdc48254d8a3/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 01:59:57.294974 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.295429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.295533 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.323057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] MFA Rules not processed for user `c978bcb82438457086abbdc48254d8a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 01:59:57.324271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:57.392454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1321/2680] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 01:59:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 01:59:57.405008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 01:59:57.408939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 01:59:57.473788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83031e0-ed9a-4eb4-b0e8-21a94f9092bf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 01:59:57.477510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 01:59:57.478156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 01:59:57.478415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 01:59:57.478689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 01:59:57.543510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 01:59:57.545140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 01:59:57.555559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1360/2681] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 01:59:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:00.165405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:00.177333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66554ca0-d197-4341-bc28-e85eb92653c7 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:00.181248 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:00.181692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:00.182160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:00.182415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:00.195092 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:00.196661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b215f-b245-48c7-88ef-1f5179ff7843 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:00.202356 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:00.214277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1322/2682] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:01.665789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:01.667302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:01.752709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:01.773564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e79ced-1a46-491d-bdcb-ca0d9bb91abb service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:01.779637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:01.780757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:01.780994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:01.781359 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:01.783288 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:01.871200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:01.873305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:01.883850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1361/2683] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:01 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:03.180636 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133685e5-0d60-4266-a225-4ccd5bcc6fbe None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:03.181133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133685e5-0d60-4266-a225-4ccd5bcc6fbe None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:03.181231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133685e5-0d60-4266-a225-4ccd5bcc6fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:03.200957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-133685e5-0d60-4266-a225-4ccd5bcc6fbe None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:03.202180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-133685e5-0d60-4266-a225-4ccd5bcc6fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:03.262275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1323/2684] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 02:00:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:03.278870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:03.280419 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:03.351383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f28948-7361-4174-9579-8066ce03686b service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:03.356405 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:03.356993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:03.357265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:03.357546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:03.365821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:03.367422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:03.375868 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1362/2685] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 02:00:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 16 02:00:10.368400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f9ed-9ab5-447f-b28c-3e94d133dfe3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:10.368921 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f9ed-9ab5-447f-b28c-3e94d133dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:10.369035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b362f9ed-9ab5-447f-b28c-3e94d133dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:10.388645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b362f9ed-9ab5-447f-b28c-3e94d133dfe3 None None] MFA Rules not processed for user `f3d6b85899d4402db6611333605e812b`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:10.389838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b362f9ed-9ab5-447f-b28c-3e94d133dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:10.445272 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1324/2686] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:12.913992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:12.977675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1457f-3355-458c-aa7a-44cf03e5384e service swift] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:12.982869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:12.984082 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:12.984535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:12.984908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] PATH_INFO: `/v3/users/97085c33ec85447e8d20f06af4fcce45` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:12.986592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97085c33ec85447e8d20f06af4fcce45)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:12.989196 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:13.027753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:13.044613 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97085c33ec85447e8d20f06af4fcce45'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.054621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97085c33ec85447e8d20f06af4fcce45'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.055299 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97085c33ec85447e8d20f06af4fcce45'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.068508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97085c33ec85447e8d20f06af4fcce45'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.075815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97085c33ec85447e8d20f06af4fcce45'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.081686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1363/2687] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:12 2022] DELETE /identity/v3/users/97085c33ec85447e8d20f06af4fcce45 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:13.086251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:13.086718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:13.086900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:13.106629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:13.107936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:13.169663 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1325/2688] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:13.184918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:13.186788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:13.247754 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eccd50-c41b-429b-bed9-556552ca2aa7 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:13.251660 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:13.252264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:13.252532 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:13.252856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:13.287128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:13.288586 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:13.307307 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1364/2689] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:13.768074 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:13.769621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:13.783567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b8a09b-cc37-4dc4-b17f-fc5bdd796c6b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:13.790030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:13.790723 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:13.791013 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:13.791286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] PATH_INFO: `/v3/projects/c21601270aab46e9bbe05a6d945c479c` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:13.792435 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c21601270aab46e9bbe05a6d945c479c)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:13.794417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:13.841556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:13.844832 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c21601270aab46e9bbe05a6d945c479c', 'request_id': 'req-f3f275db-f9c3-4d69-9517-9a1cc0818b48'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.852660 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c21601270aab46e9bbe05a6d945c479c', 'request_id': 'req-f3f275db-f9c3-4d69-9517-9a1cc0818b48'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.858171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c21601270aab46e9bbe05a6d945c479c', 'request_id': 'req-f3f275db-f9c3-4d69-9517-9a1cc0818b48'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.869740 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] The token cache is being invalidate because project c21601270aab46e9bbe05a6d945c479c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:13.870060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.870736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.872275 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1326/2690] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:13 2022] DELETE /identity/v3/projects/c21601270aab46e9bbe05a6d945c479c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:13.876227 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:13.885970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f36665-9b7d-45d1-900a-d86b62c12d2c service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:13.942234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:13.942915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:13.943148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:13.943420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] PATH_INFO: `/v3/users/c978bcb82438457086abbdc48254d8a3` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:13.944542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c978bcb82438457086abbdc48254d8a3)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:13.946470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:13.994697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c978bcb82438457086abbdc48254d8a3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:13.998184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:14.002133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c978bcb82438457086abbdc48254d8a3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.003033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c978bcb82438457086abbdc48254d8a3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.016857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c978bcb82438457086abbdc48254d8a3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.023619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-11f278ac-e5a0-49d7-adc8-0fd6e4685e37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c978bcb82438457086abbdc48254d8a3'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.029371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1365/2691] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:13 2022] DELETE /identity/v3/users/c978bcb82438457086abbdc48254d8a3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:14.291941 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.293418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:14.308724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f275db-f9c3-4d69-9517-9a1cc0818b48 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.368095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.368764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.369036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.369308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] PATH_INFO: `/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.370468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d483a1d7ab04ebbb2d8a0c4e1a0e079)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.372434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.420803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d483a1d7ab04ebbb2d8a0c4e1a0e079', 'request_id': 'req-709b908e-97db-4a34-9fb5-33453a55acd7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.428380 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d483a1d7ab04ebbb2d8a0c4e1a0e079', 'request_id': 'req-709b908e-97db-4a34-9fb5-33453a55acd7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.434161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d483a1d7ab04ebbb2d8a0c4e1a0e079', 'request_id': 'req-709b908e-97db-4a34-9fb5-33453a55acd7'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.445467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] The token cache is being invalidate because project 1d483a1d7ab04ebbb2d8a0c4e1a0e079 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:14.445755 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.446436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-709b908e-97db-4a34-9fb5-33453a55acd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:14.447944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1327/2692] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:14 2022] DELETE /identity/v3/projects/1d483a1d7ab04ebbb2d8a0c4e1a0e079 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:14.454003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.454289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.454563 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.475633 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:14.476867 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:14.541072 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1366/2693] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:14.549379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.549776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.550158 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.571618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:14.573083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:14.581398 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1328/2694] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:14.585886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.595953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37718ff-479d-410e-87bf-daa4a2623040 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.601191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.601943 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.602293 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.602638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.603290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:00:14.603596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.605192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.618099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1367/2695] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:00:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:00:14.622761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.632534 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba239b93-54a2-46f1-bc19-6d9a6e4d2d43 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.637315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.637950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.638242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.638521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.639154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.641090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.672878 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1329/2696] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:14 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:00:14.674221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.685261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2e531-076d-4008-a535-372907d06f6f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.751306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.751926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.752214 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.752494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.753135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.755494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.780080 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1368/2697] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:14 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:14.784090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.795081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f06c70-8d76-45a3-9e9e-fb7e46606d49 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.800071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.800672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.800955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.801230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.802515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.804131 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.814420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1330/2698] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:14.818591 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.828856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9699b6-7d0e-44d9-befd-6a96c205574c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.834041 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.834644 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.834923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.835385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.835918 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.837759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eded81-8531-4648-9178-70c47919ee4d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.852956 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1369/2699] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:14.857644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:14.881585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c944a3-e142-4cab-83ef-69f0ed9fa6dc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:14.887016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:14.887620 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.887906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.888218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] PATH_INFO: `/v3/projects/ba137063583c4e148ec82e622f1e9c81/users/8d446346788540a5811cd5d1d345c0ac/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.903692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba137063583c4e148ec82e622f1e9c81, user_id=8d446346788540a5811cd5d1d345c0ac, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:14.906438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:14.915880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:14.921096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1331/2700] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:14 2022] PUT /identity/v3/projects/ba137063583c4e148ec82e622f1e9c81/users/8d446346788540a5811cd5d1d345c0ac/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:14.931524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4544d-1301-496c-ba9b-b838764fd305 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:14.931819 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4544d-1301-496c-ba9b-b838764fd305 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:14.932101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f4544d-1301-496c-ba9b-b838764fd305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:14.959992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b3f4544d-1301-496c-ba9b-b838764fd305 None None] MFA Rules not processed for user `8d446346788540a5811cd5d1d345c0ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:14.961245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b3f4544d-1301-496c-ba9b-b838764fd305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:14.985519 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:15.028566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1370/2701] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:15.041057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:15.042785 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:15.099654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca22791-d4ec-4f9b-84ff-92e8aff5115b admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:15.103371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '943c65ab7c814cc690876b3ba9293756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:15.103986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:15.104269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:15.104552 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:15.113072 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:15.114633 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:15.124601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1332/2702] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:15 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:25.025776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=16 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:25.120093 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=26 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:26.575240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:26.575731 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:26.575826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:26.594534 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:26.595720 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:26.653521 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1371/2703] 10.222.0.33 () {58 vars in 1009 bytes} [Fri Sep 16 02:00:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:26.666124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:26.667561 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:26.742378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1159e-6acf-4c73-8847-02d585dc9bad service glance] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:26.747400 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:26.748010 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:26.748292 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:26.748567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:26.757080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:26.758713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5332a-badb-43e6-a66a-819cc48696b7 service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:26.766934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1333/2704] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 02:00:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 02:00:36.643285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=25 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:36.763709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=32 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:38.272134 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:38.351011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad71ad-3c73-4318-acbe-3057c8af0f10 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:38.355957 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:38.356602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:38.356890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:38.357235 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] PATH_INFO: `/v3/users/8d446346788540a5811cd5d1d345c0ac` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:38.358437 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d446346788540a5811cd5d1d345c0ac)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:38.360367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:38.414113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d446346788540a5811cd5d1d345c0ac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:38.423105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d446346788540a5811cd5d1d345c0ac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:38.423782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d446346788540a5811cd5d1d345c0ac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:38.440703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d446346788540a5811cd5d1d345c0ac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:38.453509 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d446346788540a5811cd5d1d345c0ac'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:38.460823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1372/2705] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:38 2022] DELETE /identity/v3/users/8d446346788540a5811cd5d1d345c0ac => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:38.465456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:38.465990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:38.466105 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:38.488003 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:38.489182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:38.560221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1334/2706] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:00:38.568421 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:38.570308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:38.638859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ec67a-1d20-4a98-b3ba-2f7f0587508e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:38.642646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:38.643338 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:38.645995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:38.645995 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:38.660866 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:38.662603 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7caeaa-8a48-426b-944d-d93eda4ce6cb service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:38.673797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1373/2707] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:39.039863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.041656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:39.066560 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5d2dc-c12e-431d-adf9-67a160df00ac None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.072598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.073328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.080906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.082530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] PATH_INFO: `/v3/projects/ba137063583c4e148ec82e622f1e9c81` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.086786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba137063583c4e148ec82e622f1e9c81)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.089584 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.155988 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba137063583c4e148ec82e622f1e9c81', 'request_id': 'req-76bdf454-e2ad-4882-9fe5-4d57c1c14496'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:39.167351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba137063583c4e148ec82e622f1e9c81', 'request_id': 'req-76bdf454-e2ad-4882-9fe5-4d57c1c14496'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:39.175048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba137063583c4e148ec82e622f1e9c81', 'request_id': 'req-76bdf454-e2ad-4882-9fe5-4d57c1c14496'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:39.189809 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] The token cache is being invalidate because project ba137063583c4e148ec82e622f1e9c81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:39.190115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:39.190934 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-76bdf454-e2ad-4882-9fe5-4d57c1c14496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:39.193736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1335/2708] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:39 2022] DELETE /identity/v3/projects/ba137063583c4e148ec82e622f1e9c81 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:39.198573 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.198843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.199175 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.228926 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:39.230121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:39.249028 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:39.313905 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1374/2709] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:39.316501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.317017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.317441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.343090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:39.345253 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:39.357521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1336/2710] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:39.361830 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.381897 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9468eee-673d-436a-a3ca-036242fee160 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.387745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.388352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.388641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.388915 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.389898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:00:39.389898 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.391953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.405355 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1375/2711] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:00:39.409720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.426038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfa1c62-7754-4177-9d76-ad65328d0dc3 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.436354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.437567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.438114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.438629 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.439632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.442871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.478766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1337/2712] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:39 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:39.479901 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.490980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f0a36-2f54-4639-bb8d-293ec6714ea4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.552417 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.553029 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.553306 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.553576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.554254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.556138 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.581200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1376/2713] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:39 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:39.582414 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.595406 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a45bad-03bb-41fa-a719-7e7a04551a42 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.600245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.600855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.601133 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.601408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.602075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.603682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.617423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1338/2714] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:39.618826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.629497 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b702d-ec17-49c9-8f35-799ee4c2a0cd admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.635350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.635947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.636225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.636494 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.637128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.639141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9428d1-5574-416a-ad2c-1420eb7ad0d7 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.653610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1377/2715] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:39.654871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.666590 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca014f2e-6d9f-48ab-b4bb-3e82c863668f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.671514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.672508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.673070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.673357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] PATH_INFO: `/v3/projects/0dd84ffdb253434c9b36b0bc274447b0/users/8aef3382a88c4f2c8de8f898d105cc3d/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.689957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dd84ffdb253434c9b36b0bc274447b0, user_id=8aef3382a88c4f2c8de8f898d105cc3d, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.693384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.706846 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1339/2716] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:39 2022] PUT /identity/v3/projects/0dd84ffdb253434c9b36b0bc274447b0/users/8aef3382a88c4f2c8de8f898d105cc3d/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:39.717880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.718182 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.718553 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.751632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] MFA Rules not processed for user `8aef3382a88c4f2c8de8f898d105cc3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:39.753610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:39.833320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1378/2717] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:39.845315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:39.847171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:39.877453 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:39.921779 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263e56-6d11-424a-b5b6-31f7aa3f3d84 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:39.926117 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:39.927529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:39.928038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:39.928649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:39.939813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:39.941530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62999c-0a33-4ccc-b397-f99d90877030 service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:39.956411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1340/2718] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:39.988953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:40.010668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:40.069788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b142d6-5e6b-43db-b4d9-03c2e45f183b None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:40.075562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:40.075562 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:40.075823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:40.076098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] PATH_INFO: `/v3/users/8aef3382a88c4f2c8de8f898d105cc3d` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:40.077848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aef3382a88c4f2c8de8f898d105cc3d)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:40.080981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:40.138597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aef3382a88c4f2c8de8f898d105cc3d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.148014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aef3382a88c4f2c8de8f898d105cc3d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.149121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aef3382a88c4f2c8de8f898d105cc3d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.164107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aef3382a88c4f2c8de8f898d105cc3d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.178170 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aef3382a88c4f2c8de8f898d105cc3d'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.184476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1379/2719] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:39 2022] DELETE /identity/v3/users/8aef3382a88c4f2c8de8f898d105cc3d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:40.189087 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:40.189376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:40.189649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:40.213316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:40.214567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:40.291872 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1341/2720] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:40.298322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:40.300242 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:40.381142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfd724-2912-4fba-b6fb-9c0d74b15276 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:40.385143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:40.385839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:40.386150 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:40.386743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:40.400587 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:40.402078 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3b666a-c2d1-4fa9-a80a-382a9c83f4a6 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:40.418064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1380/2721] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:40.772244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:40.774669 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:40.789454 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dce5e-1993-47b7-9075-14e4dc7eecbf None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:40.797329 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:40.798168 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:40.798645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:40.800489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] PATH_INFO: `/v3/projects/0dd84ffdb253434c9b36b0bc274447b0` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:40.801831 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dd84ffdb253434c9b36b0bc274447b0)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:40.804300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:40.861753 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dd84ffdb253434c9b36b0bc274447b0', 'request_id': 'req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.871765 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dd84ffdb253434c9b36b0bc274447b0', 'request_id': 'req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.878923 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dd84ffdb253434c9b36b0bc274447b0', 'request_id': 'req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.893199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] The token cache is being invalidate because project 0dd84ffdb253434c9b36b0bc274447b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:40.893544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.894231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-e9bacdf8-3dba-4ea2-a9ee-a776d7e2ddc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:40.897123 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1342/2722] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:40 2022] DELETE /identity/v3/projects/0dd84ffdb253434c9b36b0bc274447b0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 02:00:40.901694 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:40.902037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:40.902315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:40.923679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:40.924840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:40.963953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:41.026582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1381/2723] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:41.034442 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.034733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.035012 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.055246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:41.056461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:41.065344 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1343/2724] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:41.070734 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.083352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079dbaa-1fe0-431f-bc32-b3518b198849 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.090053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.090785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.091171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.091668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.092428 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:00:41.092805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.094549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.110537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1382/2725] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:00:41.115598 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.127155 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b45fd8-9de0-43c4-847c-f6be80639b40 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.133128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.134224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.134718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.135071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.135733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.137679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.172151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1344/2726] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:41 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:41.177772 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.199533 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f556bd-56cd-4afe-8ac4-9dcc99a46c3c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.264788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.265712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.266194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.266654 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.267513 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.269651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.295520 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1383/2727] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:41 2022] POST /identity/v3/users => generated 286 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:41.299985 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.312437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de75d4-ab11-4c30-a5af-16588b05dcce admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.318463 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.319120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.319421 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.319697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.321833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.322005 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.337677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1345/2728] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:41.339037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.350013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707f71b-2e06-4079-a7ee-043c68b4a167 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.355304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.355913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.356194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.356508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.357398 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.359310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b622-9be7-479b-9fec-7fb90a249ac3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.378280 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1384/2729] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:41.378875 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.390570 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1539-271b-4332-b407-c9662076e75d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.397942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.398670 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.398896 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.399171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] PATH_INFO: `/v3/projects/bc90050e08ad42168795c2844e84fbd7/users/63f9964527784e82a4ce52119cbc747e/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.401504 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:41.431388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc90050e08ad42168795c2844e84fbd7, user_id=63f9964527784e82a4ce52119cbc747e, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.434144 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.459352 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1346/2730] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:41 2022] PUT /identity/v3/projects/bc90050e08ad42168795c2844e84fbd7/users/63f9964527784e82a4ce52119cbc747e/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:41.467388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3e86-6d8d-4ce7-a99e-3855aced9156 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.467893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3e86-6d8d-4ce7-a99e-3855aced9156 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.467992 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b3e86-6d8d-4ce7-a99e-3855aced9156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.497148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ff2b3e86-6d8d-4ce7-a99e-3855aced9156 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:41.498881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ff2b3e86-6d8d-4ce7-a99e-3855aced9156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:41.576517 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1385/2731] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:41.587126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:41.588980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:41.653556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb651c1-f303-4db5-b6fc-873f2126f7a9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:41.657514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:41.658189 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:41.658475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:41.658751 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:41.668978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:41.670510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:41.681537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1347/2732] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:42.145784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:42.146098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:42.146372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:42.166123 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] MFA Rules not processed for user `1a82594a77b542e5be1ea542cbfdf70b`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:42.167326 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:42.209283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:42.225178 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1386/2733] 10.222.0.33 () {58 vars in 967 bytes} [Fri Sep 16 02:00:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:42.237178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:42.238842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:42.320618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ad566-b012-4eae-94e0-afe25e4ff985 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:42.326439 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '833561908cfb4105b9851563d4253138', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:42.327205 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:42.327579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:42.331464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:42.340585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:42.342550 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:42.352221 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1348/2734] 10.222.0.33 () {60 vars in 1384 bytes} [Fri Sep 16 02:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 16 02:00:44.460544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:44.462172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:44.487365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e1426-5c98-4d6e-883f-3d972357c078 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:44.493585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:44.494717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:44.495216 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:44.495727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] PATH_INFO: `/v3/users/f3d6b85899d4402db6611333605e812b` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:44.497375 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3d6b85899d4402db6611333605e812b)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:44.499833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:44.568387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3d6b85899d4402db6611333605e812b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:44.577659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3d6b85899d4402db6611333605e812b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:44.578496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3d6b85899d4402db6611333605e812b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:44.597689 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3d6b85899d4402db6611333605e812b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:44.606188 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-c99b66b3-5493-41cc-9403-44619af6bbcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3d6b85899d4402db6611333605e812b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:44.613564 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1387/2735] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:44 2022] DELETE /identity/v3/users/f3d6b85899d4402db6611333605e812b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 02:00:44.907675 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:44.928347 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99dbd6-eb7f-4ccc-b86f-19615f6cacac service swift] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.045634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.046797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.047143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.047488 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] PATH_INFO: `/v3/projects/11b37406c6994be0b5e6241dd2dbda9f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.048887 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b37406c6994be0b5e6241dd2dbda9f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.050924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.077260 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:45.114402 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b37406c6994be0b5e6241dd2dbda9f', 'request_id': 'req-6529b410-920b-46da-802a-5239f3fb0964'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:45.122776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b37406c6994be0b5e6241dd2dbda9f', 'request_id': 'req-6529b410-920b-46da-802a-5239f3fb0964'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:45.132115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b37406c6994be0b5e6241dd2dbda9f', 'request_id': 'req-6529b410-920b-46da-802a-5239f3fb0964'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:45.148464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] The token cache is being invalidate because project 11b37406c6994be0b5e6241dd2dbda9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:45.148894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:45.150944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-6529b410-920b-46da-802a-5239f3fb0964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:45.156019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1349/2736] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:44 2022] DELETE /identity/v3/projects/11b37406c6994be0b5e6241dd2dbda9f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:45.159282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.159570 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.159846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.185805 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:45.187385 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:45.284612 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1388/2737] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:45.292684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.292973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.293256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.314682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:45.315939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:45.324726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1350/2738] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:45.329151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.342241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261a43-ca0a-4cd7-bdcd-065a4e492070 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.348953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.349961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.349961 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.350221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.350802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:00:45.351109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.352764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.366747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1389/2739] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:00:45.371039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.382305 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b17a5-9d87-44fc-a36b-3b57baf88c37 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.389017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.389683 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.390082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.390851 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.391078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.393050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.430082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1351/2740] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:45 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:00:45.431192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.441295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e287943-2a45-4976-ab69-2eae2250155b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.501146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:45.519334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.520802 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.521890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.522289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.524824 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.526815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.565550 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1390/2741] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:45 2022] POST /identity/v3/users => generated 291 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:45.569807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.585975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc43a4a-0cc7-4a03-9eb8-6ec99ae07438 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.593979 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.594791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.595212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.595594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.596388 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.598833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.612886 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1352/2742] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:00:45.614834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.625114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b19874-f300-46e8-80b7-e4bdced90928 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.629796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.630436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.630721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.630997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.631641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.633225 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b7566-0da4-4311-8dee-d9e8e61d35ba admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.648191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1391/2743] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:45.649371 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.662358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e99dc-52b0-4319-8573-d56875cd1f2a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.671724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.672484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.672869 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.673247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] PATH_INFO: `/v3/projects/c6e3c94a8ad14556b8d0471f9dd4c4e7/users/e5912b2f23fe4a0489cbd28eacc9a7ba/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.690254 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e3c94a8ad14556b8d0471f9dd4c4e7, user_id=e5912b2f23fe4a0489cbd28eacc9a7ba, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.693251 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.710498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1353/2744] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:45 2022] PUT /identity/v3/projects/c6e3c94a8ad14556b8d0471f9dd4c4e7/users/e5912b2f23fe4a0489cbd28eacc9a7ba/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:45.715581 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca728-e4cf-43f0-98cb-92028706aa06 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.715870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca728-e4cf-43f0-98cb-92028706aa06 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.716197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ca728-e4cf-43f0-98cb-92028706aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.743865 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-640ca728-e4cf-43f0-98cb-92028706aa06 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:45.745104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-640ca728-e4cf-43f0-98cb-92028706aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:45.826054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1392/2745] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:45.841222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:45.843050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:45.944447 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be2a493-fef3-422b-ba7a-ae96184139da admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:45.948154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:45.948766 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:45.949049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:45.949511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:45.960116 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:45.961758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:45.978094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1354/2746] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:46.989127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ff4-6517-41fd-a0d6-5773dc86138a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:46.989621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ff4-6517-41fd-a0d6-5773dc86138a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:46.989716 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5e4ff4-6517-41fd-a0d6-5773dc86138a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.045366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-bd5e4ff4-6517-41fd-a0d6-5773dc86138a None None] MFA Rules not processed for user `e5912b2f23fe4a0489cbd28eacc9a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:47.050721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bd5e4ff4-6517-41fd-a0d6-5773dc86138a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:47.182914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1393/2747] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:47.194426 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.195864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:47.277091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:47.310529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cae45a-dd96-4a86-b779-e341651f60fd service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:47.315332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.315626 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.315906 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.325437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:47.326479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.327856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.328363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.347281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:47.349458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] MFA Rules not processed for user `63f9964527784e82a4ce52119cbc747e`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:47.350354 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:47.350718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:47.370587 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1355/2748] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:47.417371 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:47.456432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1394/2749] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:47.458057 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.459748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:47.493225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d23b1-e579-48cd-8d7b-d273e27256fd service cinder] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:47.503328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:47.504095 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.504505 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.505141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.505741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:47.509489 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:47.565428 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1356/2750] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:47 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:47.570640 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.590798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6035a4-b264-44cf-bddb-a71b8ec423ba None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:47.695726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:47.696545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.696968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.697505 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.698579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:47.701763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:47.737111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1395/2751] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:47 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:47.743078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.763924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cad92-3e77-4ea2-a28c-6c9de62305b6 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:47.782195 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:47.783951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.784342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.784657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.786482 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:47.788157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:47.820997 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1357/2752] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:47.824079 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.845186 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e51cfe-a88f-4107-9896-40c66c3000cf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:47.863320 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:47.865718 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:47.866038 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:47.866410 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] PATH_INFO: `/v3/projects/84d8697b447c42259d9535279be4c5b3/users/b17c8f36247e4bfa96e465b6543714df/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:47.911332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d8697b447c42259d9535279be4c5b3, user_id=b17c8f36247e4bfa96e465b6543714df, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:47.921685 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:47.959451 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1396/2753] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:47 2022] PUT /identity/v3/projects/84d8697b447c42259d9535279be4c5b3/users/b17c8f36247e4bfa96e465b6543714df/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:47.961138 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:47.980500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b929a-d4b0-438c-97fa-0e6dd47160b9 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:48.078103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:48.078762 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:48.079066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:48.079395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:48.080106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:48.081792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66c1d3-34e2-49aa-8e1b-3203a08289bc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:48.096696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1358/2754] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:00:48.101276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:48.116341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714281b-9bc9-40eb-8bfe-fa52bf9105d4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:48.122843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:48.123853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:48.124261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:48.124602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] PATH_INFO: `/v3/projects/84d8697b447c42259d9535279be4c5b3/users/b17c8f36247e4bfa96e465b6543714df/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:48.127025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d8697b447c42259d9535279be4c5b3, user_id=b17c8f36247e4bfa96e465b6543714df, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:48.129814 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:48.147469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1397/2755] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:48 2022] PUT /identity/v3/projects/84d8697b447c42259d9535279be4c5b3/users/b17c8f36247e4bfa96e465b6543714df/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:49.080496 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:49.081471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:49.081978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:49.106746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] MFA Rules not processed for user `e5912b2f23fe4a0489cbd28eacc9a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:49.108907 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:49.196160 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1359/2756] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:49.502696 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:49.614938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7420308f-b730-44b0-b6f0-2d9875490614 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:49.620425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:49.623747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:49.623747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:49.623747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:49.627566 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:49.639271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:49.641282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ddccc0-5ee2-4379-a053-c1c12873b394 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:49.654035 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1398/2757] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:50.973340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:50.990508 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646ea54-31ad-455e-b09a-d9091ec13bee None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:51.007591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:51.008495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:51.009271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:51.009732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:51.021016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:51.146280 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:51.173106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:51.175185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:51.200696 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1360/2758] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:55.461245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:55.461705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:55.461705 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:55.493675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] MFA Rules not processed for user `b17c8f36247e4bfa96e465b6543714df`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:55.495786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:55.545127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:55.602473 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1399/2759] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:55.617004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:55.618487 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:55.709654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c90e5a-0e10-4e87-8b3a-c022bc013f6d service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:55.715797 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:55.716412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:55.716695 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:55.716969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:55.780230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:55.781906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:55.793803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1361/2760] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:00:55.851712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:55.853750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:55.878378 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c3412-53b2-46d6-a856-3c7b2d59c08f None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:55.883156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:55.884107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:55.884391 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:55.884667 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] PATH_INFO: `/v3/users/a1f0fb63df7642eba4d93fc5d713c704` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:55.885840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1f0fb63df7642eba4d93fc5d713c704)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:55.888425 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:55.939427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1f0fb63df7642eba4d93fc5d713c704'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:55.946927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1f0fb63df7642eba4d93fc5d713c704'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:55.947597 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1f0fb63df7642eba4d93fc5d713c704'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:55.960888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1f0fb63df7642eba4d93fc5d713c704'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:55.967678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-a9b5bec4-62ef-4833-ae5a-0642ecbf5950 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1f0fb63df7642eba4d93fc5d713c704'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:55.974608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1400/2761] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:00:55 2022] DELETE /identity/v3/users/a1f0fb63df7642eba4d93fc5d713c704 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:56.261656 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.272792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76215179-8eed-44ce-8b1b-78efeceae7c8 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.341327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.342061 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.342469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.342750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] PATH_INFO: `/v3/projects/309262b0028e46e9a9d08b7652060c02` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.344226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=309262b0028e46e9a9d08b7652060c02)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.346236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.394873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:56.420697 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '309262b0028e46e9a9d08b7652060c02', 'request_id': 'req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:56.433375 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '309262b0028e46e9a9d08b7652060c02', 'request_id': 'req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:56.440750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '309262b0028e46e9a9d08b7652060c02', 'request_id': 'req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:56.456609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] The token cache is being invalidate because project 309262b0028e46e9a9d08b7652060c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:00:56.457912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:56.458623 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7f7616d5-21d2-479b-a1e3-c0e6fd92faf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:00:56.460490 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1362/2762] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:00:56 2022] DELETE /identity/v3/projects/309262b0028e46e9a9d08b7652060c02 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:56.466234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.467140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.468126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.490890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:56.492055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:56.573526 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1401/2763] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:56.581555 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.581950 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.582706 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.607519 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:56.610258 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:56.619501 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1363/2764] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:00:56.623664 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.635366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e6be33-e167-4791-b1c2-bee664a4a996 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.640144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.640764 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.641052 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.641329 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.642024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:00:56.642343 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.643933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.657344 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1402/2765] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:00:56.661665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.672152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762724c-6e01-470e-97e6-7f8439f3cc2a None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.687322 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.689118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.689408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.690290 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.691011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.694113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.733088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1364/2766] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:00:56 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:00:56.737034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.748649 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94cf1-104f-414d-9e86-b329a125b4b2 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.776618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:56.817496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.817842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.818728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.819107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.819817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.821899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.857936 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1403/2767] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:00:56 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:00:56.859467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.879803 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf346e9-836f-4649-8b00-453e828822bb admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.887127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.887971 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.888817 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.889286 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.890441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.893182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.909474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1365/2768] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:00:56.916069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.928363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cbc6be-3872-4dc1-aaf2-b464913b5305 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.933919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.934614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.935130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.935496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:56.936212 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:56.937902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b5eba-f53f-4efe-8126-cc56c9eabd1b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:56.968159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:56.976169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1404/2769] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:00:56.982760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af01a26-5c19-47e7-976c-569802f97356 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:56.991306 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:56.996639 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:56.996936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:56.997216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] PATH_INFO: `/v3/projects/53cb99d7c9344f2b871f34af4c3ccd26/users/d58d2cfc34da42dba167b8b780da7454/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:57.018811 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cb99d7c9344f2b871f34af4c3ccd26, user_id=d58d2cfc34da42dba167b8b780da7454, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:57.023601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311c07a0-45d1-4ace-b65d-5652c07c68da admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:57.040429 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1366/2770] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:00:56 2022] PUT /identity/v3/projects/53cb99d7c9344f2b871f34af4c3ccd26/users/d58d2cfc34da42dba167b8b780da7454/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:00:57.052233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:57.052969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:57.053408 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:57.117665 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008b17-b931-4125-9709-be4756e31641 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:57.118034 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008b17-b931-4125-9709-be4756e31641 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:57.118261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09008b17-b931-4125-9709-be4756e31641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:57.134057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] MFA Rules not processed for user `d58d2cfc34da42dba167b8b780da7454`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:57.134057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:57.144468 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-09008b17-b931-4125-9709-be4756e31641 None None] MFA Rules not processed for user `63f9964527784e82a4ce52119cbc747e`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:00:57.145712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09008b17-b931-4125-9709-be4756e31641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:57.220733 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1367/2771] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:00:57.234577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1405/2772] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:00:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:00:57.246201 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09008b17-b931-4125-9709-be4756e31641 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:00:57.247657 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-09008b17-b931-4125-9709-be4756e31641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:00:57.315091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:57.336938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09008b17-b931-4125-9709-be4756e31641 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:00:57.342644 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:00:57.343257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:00:57.343535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:00:57.343810 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:00:57.352492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:00:57.354179 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01b22f8-2fd0-423f-972c-f896889efd45 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:00:57.364110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1368/2773] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:00:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:00.196057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:00.264022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1be31e-d1c9-413a-ac92-a3909d6ad693 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:00.266621 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:00.267496 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:00.267859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:00.270161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] PATH_INFO: `/v3/users/d58d2cfc34da42dba167b8b780da7454` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:00.270161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d58d2cfc34da42dba167b8b780da7454)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:00.272172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:00.314962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:00.324443 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd58d2cfc34da42dba167b8b780da7454'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:00.332547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd58d2cfc34da42dba167b8b780da7454'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:00.333276 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd58d2cfc34da42dba167b8b780da7454'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:00.346031 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd58d2cfc34da42dba167b8b780da7454'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:00.353286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd58d2cfc34da42dba167b8b780da7454'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:00.359810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1406/2774] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:00 2022] DELETE /identity/v3/users/d58d2cfc34da42dba167b8b780da7454 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:00.364736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:00.365231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:00.365339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:00.386936 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:00.388654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:00.453739 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1369/2775] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:00.463537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:00.465024 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:00.526469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3c5b82-fb9d-4f93-b824-d8676d0a8f5b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:00.531755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:00.531755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:00.531755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:00.531755 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:00.542402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:00.543834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206de503-eb3f-47a5-ba66-2a62862ee6fb service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:00.554474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1407/2776] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:00.916643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:00.918243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:00.931477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d48091-3b70-47e3-a45c-12380543d588 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:00.939989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:00.940465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:00.940746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:00.941728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] PATH_INFO: `/v3/projects/53cb99d7c9344f2b871f34af4c3ccd26` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:00.943120 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cb99d7c9344f2b871f34af4c3ccd26)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:00.945791 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:00.998864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cb99d7c9344f2b871f34af4c3ccd26', 'request_id': 'req-015b07d2-1a22-47ed-a290-d7e39f82f703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:01.007859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cb99d7c9344f2b871f34af4c3ccd26', 'request_id': 'req-015b07d2-1a22-47ed-a290-d7e39f82f703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:01.014471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cb99d7c9344f2b871f34af4c3ccd26', 'request_id': 'req-015b07d2-1a22-47ed-a290-d7e39f82f703'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:01.029303 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] The token cache is being invalidate because project 53cb99d7c9344f2b871f34af4c3ccd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:01.029600 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:01.030287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-015b07d2-1a22-47ed-a290-d7e39f82f703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:01.032001 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1370/2777] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:00 2022] DELETE /identity/v3/projects/53cb99d7c9344f2b871f34af4c3ccd26 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:01.036933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.037575 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.038114 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.063740 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:01.067130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:01.151122 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1408/2778] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:01.160358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.160645 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.160925 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.183147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:01.187897 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:01.202814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1371/2779] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:01.205970 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.219722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff3a2b-286d-4c39-99e7-ba00011f4611 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.226295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.227121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.227402 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.227699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.228352 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:01.228662 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.230369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.242923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1409/2780] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:01.247628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.257710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e8e31-fbb7-450a-93fa-ad560a8831c6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.262863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.263477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.263750 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.264016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.264649 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.266588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.296650 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1372/2781] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:01.301105 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.311459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d195d4-20f8-4046-bf8e-0395e8cfda19 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.364848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:01.379938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.380549 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.380843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.381118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.381757 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.384020 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.409479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1410/2782] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:01.414207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.426324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d7907-fa6c-49f8-8a20-340c85d2fcee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.431330 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.431954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.432235 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.432514 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.433209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.434795 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.445719 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1373/2783] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:01.449986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.460717 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb488d-4bfd-4879-930f-2b9989bf50cd admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.465452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.466088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.466370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.466642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.467275 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.468856 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274da158-4a37-4f20-8a52-f91941e6d933 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.480881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1411/2784] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:01.485090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.496725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf2619-b41d-4234-9079-18897dfd1f5c admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.501405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.502088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.502372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.502648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] PATH_INFO: `/v3/projects/df4954fbacdf4818aa1746c528452593/users/9dc2d5fd979943718e5cc45701d9bc0a/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.517881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df4954fbacdf4818aa1746c528452593, user_id=9dc2d5fd979943718e5cc45701d9bc0a, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.520611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.534050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1374/2785] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:01 2022] PUT /identity/v3/projects/df4954fbacdf4818aa1746c528452593/users/9dc2d5fd979943718e5cc45701d9bc0a/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:01.545116 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.545558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.545843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.577631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] MFA Rules not processed for user `9dc2d5fd979943718e5cc45701d9bc0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:01.578890 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:01.652723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1412/2786] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:01.657167 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.669194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:01.733987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f3f9-01ae-4424-b11c-7e24589b6ea8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.739383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.739994 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.740278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.740569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.741199 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.743172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.769368 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1375/2787] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:01.773131 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.783674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc038bcb-26ff-4136-92c3-1b4bb00b11aa None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.843919 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.844522 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.844803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.845073 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.845760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.848257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.870737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1413/2788] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:01 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:01.874684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.885036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cddda06-f222-4867-85b0-ded6224ae036 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.889634 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.890263 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.890542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.890813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.891466 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.893222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.903801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1376/2789] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:01.908133 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.918803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1e545-646a-453a-a63c-f84372e47fe2 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:01.923370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:01.924026 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:01.924305 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:01.924634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] PATH_INFO: `/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7/users/72e1efeeca164b76b966825ac23d372d/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:01.951782 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b5c13ea5ba44dcbfb0e12c08b60df7, user_id=72e1efeeca164b76b966825ac23d372d, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:01.954502 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:01.971091 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1414/2790] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:01 2022] PUT /identity/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7/users/72e1efeeca164b76b966825ac23d372d/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:01.975423 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:01.986612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e333d542-68ea-4621-8627-34aba32d48d8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:02.054081 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:02.054721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.055043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.055269 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.055885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:02.057513 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd195-a71d-457d-9c5e-684226e1acf2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:02.072276 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1377/2791] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:01:02.073831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:02.087797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab756b22-5798-41f0-b370-1b697e76b3ee admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:02.093159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:02.093849 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.094166 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.094435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] PATH_INFO: `/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7/users/72e1efeeca164b76b966825ac23d372d/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.097213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1b5c13ea5ba44dcbfb0e12c08b60df7, user_id=72e1efeeca164b76b966825ac23d372d, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:02.100157 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:02.111643 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1415/2792] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:02 2022] PUT /identity/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7/users/72e1efeeca164b76b966825ac23d372d/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:02.122973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.123267 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.123542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.151909 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] MFA Rules not processed for user `72e1efeeca164b76b966825ac23d372d`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:02.153333 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:02.221332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:02.234393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1378/2793] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:02.245968 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:02.247790 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:02.257537 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:02.310050 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d183c-1829-45ab-9247-d80a4f54f518 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:02.314142 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:02.314934 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.315218 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.315493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.324655 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:02.326100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884f8ecf-e98f-4ef5-8f2f-23c8b311381a service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:02.336353 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1416/2794] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:02.797767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:02.862171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e6ded7-ead3-42bd-9a66-dd5c043320d0 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:02.866704 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:02.867335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.867614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.867884 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] PATH_INFO: `/v3/users/9dc2d5fd979943718e5cc45701d9bc0a` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.869084 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc2d5fd979943718e5cc45701d9bc0a)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:02.871127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:02.919039 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc2d5fd979943718e5cc45701d9bc0a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:02.926246 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc2d5fd979943718e5cc45701d9bc0a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:02.940268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc2d5fd979943718e5cc45701d9bc0a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:02.940954 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc2d5fd979943718e5cc45701d9bc0a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:02.947850 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc2d5fd979943718e5cc45701d9bc0a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:02.953718 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1379/2795] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:02 2022] DELETE /identity/v3/users/9dc2d5fd979943718e5cc45701d9bc0a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:02.958964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:02.959287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:02.959551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:02.981411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:02.982585 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:03.050840 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1417/2796] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:03.060427 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:03.062019 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:03.121535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164f245d-598b-44a2-87e4-375d89fe1503 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:03.125469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:03.126126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:03.126415 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:03.126694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:03.136416 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:03.137856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:03.148681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1380/2797] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:03.425265 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:03.426777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:03.461887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c490245b-d59c-4adb-a2e4-7bfeb66d4f5c None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:03.469842 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:03.471614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:03.472013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:03.472377 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] PATH_INFO: `/v3/projects/df4954fbacdf4818aa1746c528452593` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:03.476254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df4954fbacdf4818aa1746c528452593)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:03.478266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:03.528608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df4954fbacdf4818aa1746c528452593', 'request_id': 'req-796d2555-d6c0-41bc-a22e-317bd18af537'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.535997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df4954fbacdf4818aa1746c528452593', 'request_id': 'req-796d2555-d6c0-41bc-a22e-317bd18af537'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.541346 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df4954fbacdf4818aa1746c528452593', 'request_id': 'req-796d2555-d6c0-41bc-a22e-317bd18af537'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.553672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] The token cache is being invalidate because project df4954fbacdf4818aa1746c528452593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:03.553996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.554639 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.556109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1418/2798] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:03 2022] DELETE /identity/v3/projects/df4954fbacdf4818aa1746c528452593 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:03.560130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:03.571951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe46810c-d4ff-4f78-ab78-b4a1499924de service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:03.588475 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:03.631417 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:03.632065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:03.632339 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:03.632621 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] PATH_INFO: `/v3/users/72e1efeeca164b76b966825ac23d372d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:03.634082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e1efeeca164b76b966825ac23d372d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:03.636040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:03.686582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e1efeeca164b76b966825ac23d372d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.694860 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e1efeeca164b76b966825ac23d372d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.707245 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e1efeeca164b76b966825ac23d372d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.707975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e1efeeca164b76b966825ac23d372d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.714885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7cd4b0b2-3d9e-4648-9c91-372316502a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e1efeeca164b76b966825ac23d372d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:03.721161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1381/2799] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:03 2022] DELETE /identity/v3/users/72e1efeeca164b76b966825ac23d372d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:04.009121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.010796 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:04.025599 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d2555-d6c0-41bc-a22e-317bd18af537 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.062415 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:04.101460 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.102132 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.102545 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.102827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] PATH_INFO: `/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.103948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1b5c13ea5ba44dcbfb0e12c08b60df7)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.105889 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.152835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1b5c13ea5ba44dcbfb0e12c08b60df7', 'request_id': 'req-1d3440b8-a448-453c-9309-44730fd14f55'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:04.160935 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1b5c13ea5ba44dcbfb0e12c08b60df7', 'request_id': 'req-1d3440b8-a448-453c-9309-44730fd14f55'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:04.166565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1b5c13ea5ba44dcbfb0e12c08b60df7', 'request_id': 'req-1d3440b8-a448-453c-9309-44730fd14f55'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:04.178914 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] The token cache is being invalidate because project c1b5c13ea5ba44dcbfb0e12c08b60df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:04.179210 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:04.179908 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-1d3440b8-a448-453c-9309-44730fd14f55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:04.181472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1419/2800] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:04 2022] DELETE /identity/v3/projects/c1b5c13ea5ba44dcbfb0e12c08b60df7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:04.186879 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.187464 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.208127 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:04.209383 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:04.270863 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1382/2801] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:04.280034 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.280328 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.280659 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.302964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:04.304204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:04.312171 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1420/2802] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:04.316742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.326494 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94efdd95-6a3b-4aa0-8b40-b4f32449931b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.330951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.332060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.332340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.332619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.333249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:04.333553 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.335175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.346820 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1383/2803] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:04.351871 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.361102 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a5358-96c2-4d8f-b405-a862f4ad1ce9 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.365702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.366386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.366663 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.366932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.367548 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.369423 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.396593 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1421/2804] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:04.400599 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.412030 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fdb5d-0f0c-4456-a1aa-b815d94457af admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.438202 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:04.471991 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.473311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.473608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.473911 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.474562 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.476530 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.499712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1384/2805] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:04.502506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.513881 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f4a58-b584-4d68-aec9-6c55c01d2520 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.518839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.519947 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.520230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.520501 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.521155 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.522771 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.533646 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1422/2806] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:04.538224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.548378 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e80983-b891-43dc-b031-c9264f8679ee admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.553020 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.553581 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.553861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.554191 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.554815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.556412 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923aebd4-5622-40a5-840e-411d0ab5e95c admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.567497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1385/2807] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:04.571698 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.581489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c3bdb6-0271-4941-b4f8-822c954dda85 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.586449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.587085 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.587362 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.587637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] PATH_INFO: `/v3/projects/859c5bddf2cb4d85a27218ae575a8e39/users/0cb1325012a343b8b7f4521ae2ec1cce/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.604088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859c5bddf2cb4d85a27218ae575a8e39, user_id=0cb1325012a343b8b7f4521ae2ec1cce, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.606758 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.620005 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1423/2808] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:04 2022] PUT /identity/v3/projects/859c5bddf2cb4d85a27218ae575a8e39/users/0cb1325012a343b8b7f4521ae2ec1cce/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:04.630106 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259ef5-8835-4307-a612-60a972887586 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.630394 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259ef5-8835-4307-a612-60a972887586 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.630805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77259ef5-8835-4307-a612-60a972887586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.663837 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-77259ef5-8835-4307-a612-60a972887586 None None] MFA Rules not processed for user `0cb1325012a343b8b7f4521ae2ec1cce`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:04.665090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-77259ef5-8835-4307-a612-60a972887586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:04.729210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1386/2809] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:04.734065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.796145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f452a1a-2d5b-4e1a-8e03-2bdf8ec43e48 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.800902 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.801508 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.801789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.802219 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.802858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.804746 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.809263 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:04.836722 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1424/2810] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:04.840855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259ef5-8835-4307-a612-60a972887586 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.851815 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77259ef5-8835-4307-a612-60a972887586 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.922118 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.923091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.923438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.923781 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.924498 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.926569 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.949124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1387/2811] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:04 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:04.952721 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.964383 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5442ea9-11b2-490f-8a69-bc5b089e2658 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:04.969430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:04.970192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:04.970472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:04.970743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:04.971379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:04.972991 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:04.983386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1425/2812] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:04.987572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:04.997826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e676b-1044-44f4-a28a-bc1928be3c7a admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.002444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.003094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.003883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.004162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] PATH_INFO: `/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7/users/3075073456424baaab81a95eef532f94/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.020297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd82ba31b09a42a59b9558afb9f5a3b7, user_id=3075073456424baaab81a95eef532f94, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.022998 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.031521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:05.036313 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1388/2813] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:04 2022] PUT /identity/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7/users/3075073456424baaab81a95eef532f94/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:05.040241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:05.051523 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca02ec8-b5fe-493e-ad63-b429c8c7c96e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.110697 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.111459 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.111730 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.112008 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.112651 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.114797 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d721b7-f4fb-4436-a17b-6091cf8e90cd admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.124759 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1426/2814] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:05.129541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:05.143115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb6b5e-4f62-4976-afde-bbbf26d0324f admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.147953 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.148564 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.148827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.149152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] PATH_INFO: `/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7/users/3075073456424baaab81a95eef532f94/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.155444 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd82ba31b09a42a59b9558afb9f5a3b7, user_id=3075073456424baaab81a95eef532f94, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.158187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.169511 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1389/2815] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:05 2022] PUT /identity/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7/users/3075073456424baaab81a95eef532f94/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:05.181285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.181578 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.181888 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.210386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] MFA Rules not processed for user `3075073456424baaab81a95eef532f94`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:05.211949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:05.283339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1427/2816] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:05 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:05.295141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:05.296938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:05.355049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e393d8-709c-4c7d-8cb8-8008e3af3fc2 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.358682 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.359312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.359595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.359866 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.370261 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.371714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df4f89-d063-426c-80f9-595b4e50f5cc service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.382194 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1390/2817] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:05 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:05.414339 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:05.471576 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:05.478955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88544a-d7b0-4633-af20-f4c4a06cc2b7 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.483704 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.484336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.484619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.484894 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] PATH_INFO: `/v3/users/0cb1325012a343b8b7f4521ae2ec1cce` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.486125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb1325012a343b8b7f4521ae2ec1cce)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.488609 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.545833 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb1325012a343b8b7f4521ae2ec1cce'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:05.559559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb1325012a343b8b7f4521ae2ec1cce'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:05.560197 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb1325012a343b8b7f4521ae2ec1cce'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:05.573060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb1325012a343b8b7f4521ae2ec1cce'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:05.580860 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb1325012a343b8b7f4521ae2ec1cce'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:05.587285 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1428/2818] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:05 2022] DELETE /identity/v3/users/0cb1325012a343b8b7f4521ae2ec1cce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:05.591628 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.591920 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.592299 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.612544 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:05.614476 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:05.673889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1391/2819] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:05.684420 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:05.685817 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:05.751270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efd385-ff98-40c9-9dce-78cd714fd47f admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:05.755097 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:05.755703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:05.755982 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:05.756255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:05.766365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:05.767785 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:05.778430 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1429/2820] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:06.055870 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:06.057509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:06.075912 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6118a9-d90e-4de3-bc3e-de0c73457d0b None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:06.080877 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:06.082188 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.082535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.082880 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] PATH_INFO: `/v3/projects/859c5bddf2cb4d85a27218ae575a8e39` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.084190 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=859c5bddf2cb4d85a27218ae575a8e39)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:06.086319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:06.134312 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859c5bddf2cb4d85a27218ae575a8e39', 'request_id': 'req-03926863-ba42-4132-be37-74c91a3199a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.141405 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859c5bddf2cb4d85a27218ae575a8e39', 'request_id': 'req-03926863-ba42-4132-be37-74c91a3199a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.147630 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859c5bddf2cb4d85a27218ae575a8e39', 'request_id': 'req-03926863-ba42-4132-be37-74c91a3199a0'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.158799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] The token cache is being invalidate because project 859c5bddf2cb4d85a27218ae575a8e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:06.159096 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.160366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.161917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1392/2821] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:06 2022] DELETE /identity/v3/projects/859c5bddf2cb4d85a27218ae575a8e39 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:06.165979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:06.175821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1082c9-c69d-4a66-8421-798319f8c2c8 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:06.244608 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:06.245243 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.245527 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.245801 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] PATH_INFO: `/v3/users/3075073456424baaab81a95eef532f94` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.246946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3075073456424baaab81a95eef532f94)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:06.248879 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:06.274668 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:06.303503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3075073456424baaab81a95eef532f94'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.310781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3075073456424baaab81a95eef532f94'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.311396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3075073456424baaab81a95eef532f94'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.323571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3075073456424baaab81a95eef532f94'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.330266 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-b6d21520-95f1-45d1-bd15-cd0731084410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3075073456424baaab81a95eef532f94'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.336617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1430/2822] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:06 2022] DELETE /identity/v3/users/3075073456424baaab81a95eef532f94 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:06.610864 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:06.612268 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:06.638143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03926863-ba42-4132-be37-74c91a3199a0 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:06.648085 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:06.703478 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:06.704045 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.704323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.704595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] PATH_INFO: `/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.705715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd82ba31b09a42a59b9558afb9f5a3b7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:06.707738 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:06.754523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd82ba31b09a42a59b9558afb9f5a3b7', 'request_id': 'req-7ea5ccb0-45a8-4439-894f-ecb54beb885a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.762374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd82ba31b09a42a59b9558afb9f5a3b7', 'request_id': 'req-7ea5ccb0-45a8-4439-894f-ecb54beb885a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.767932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd82ba31b09a42a59b9558afb9f5a3b7', 'request_id': 'req-7ea5ccb0-45a8-4439-894f-ecb54beb885a'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.778882 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] The token cache is being invalidate because project bd82ba31b09a42a59b9558afb9f5a3b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:06.779198 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.779814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-7ea5ccb0-45a8-4439-894f-ecb54beb885a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:06.781316 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1393/2823] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:06 2022] DELETE /identity/v3/projects/bd82ba31b09a42a59b9558afb9f5a3b7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:06.786396 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.786892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.786993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.807071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:06.808271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:06.867156 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1431/2824] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:01:06.875420 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.875708 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.875986 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.898148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:06.899390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:06.908011 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1394/2825] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:06.912373 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:06.922259 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289b6e6-d48d-41fa-8ea0-14591d558f28 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:06.927394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:06.928003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.928283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.928557 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.929201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:06.929510 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:06.931126 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:06.943119 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1432/2826] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:06.947689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:06.957343 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4696c-7ed8-4edc-8ad2-84d83b20afed None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:06.962906 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:06.963521 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:06.963823 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:06.964099 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:06.964735 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:06.966694 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:06.996805 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1395/2827] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:06 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:07.001013 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.011349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17094f77-89bd-4577-84fe-a0c8a4c3d850 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.071920 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.073194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.073673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.074025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.074798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.077240 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.102386 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1433/2828] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:06 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:07.106469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.117437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7024de6-82ab-4470-952d-c82d7df01c93 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.122408 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.123128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.123366 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.123717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.124325 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.125959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.136624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1396/2829] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:07.140511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.150540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec091bd6-51e5-4d46-b397-d0820c12aa12 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.155192 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.155783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.156065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.156337 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.156977 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.158611 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bded8590-2e23-464c-8928-f00b3560eb50 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.170946 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1434/2830] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:07.174617 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.185287 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7896dd2-a688-4f8c-baad-1b026d91d19e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.189933 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.190583 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.190900 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.191183 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] PATH_INFO: `/v3/projects/df683b14d2b34f4f87036f8083660141/users/f21941bd35274496ae2dc0688b6ecad0/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.205384 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=df683b14d2b34f4f87036f8083660141, user_id=f21941bd35274496ae2dc0688b6ecad0, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.208243 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.224080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1397/2831] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:07 2022] PUT /identity/v3/projects/df683b14d2b34f4f87036f8083660141/users/f21941bd35274496ae2dc0688b6ecad0/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:07.237098 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.237394 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.237678 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.245841 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:07.275932 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] MFA Rules not processed for user `f21941bd35274496ae2dc0688b6ecad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:07.277201 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:07.343598 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1435/2832] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:07 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:07.348980 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.392255 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:07.414070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d748ebfd-afc8-48d4-a9b6-a2735901f1ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.418691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.419300 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.419579 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.419854 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.420492 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.422472 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.449016 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1398/2833] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:07 2022] POST /identity/v3/projects => generated 401 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:07.453144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.465088 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7c455-c967-4dbc-884e-408ce65d37b6 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.529732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.530387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.530672 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.530975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.531631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.533582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.559466 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1436/2834] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:07 2022] POST /identity/v3/users => generated 307 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:07.563471 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.573859 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4727bc-39dd-4ddd-9f54-ef4903c725ba admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.578554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.579151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.579436 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.579713 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.580355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.581990 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.593374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1399/2835] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:07.597618 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.608213 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6adde35-e3e5-47cc-bebb-cfce9c35cc4c admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.612745 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.613388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.613671 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.613981 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] PATH_INFO: `/v3/projects/7ce27f2b1ba1462b80338977954b50ee/users/1fc04c09dde54c339911707b0eaa748a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.629959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce27f2b1ba1462b80338977954b50ee, user_id=1fc04c09dde54c339911707b0eaa748a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.632547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.646358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1437/2836] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:07 2022] PUT /identity/v3/projects/7ce27f2b1ba1462b80338977954b50ee/users/1fc04c09dde54c339911707b0eaa748a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:07.650387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.660441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0546-9108-474a-a581-0506b2300771 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.724647 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.725259 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.725540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.725813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.726551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.728121 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c5e0d-cd3a-4c9f-a98e-97c4c940a628 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.737836 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1400/2837] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:07.741978 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.752055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7cab2-94a3-4003-b251-f792e0e79ce2 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.757173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.757980 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.758264 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.758638 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] PATH_INFO: `/v3/projects/7ce27f2b1ba1462b80338977954b50ee/users/1fc04c09dde54c339911707b0eaa748a/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.761360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce27f2b1ba1462b80338977954b50ee, user_id=1fc04c09dde54c339911707b0eaa748a, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.764233 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.775547 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1438/2838] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:07 2022] PUT /identity/v3/projects/7ce27f2b1ba1462b80338977954b50ee/users/1fc04c09dde54c339911707b0eaa748a/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:07.786672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.786965 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.787247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.815982 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] MFA Rules not processed for user `1fc04c09dde54c339911707b0eaa748a`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:07.817827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:07.893507 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1401/2839] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:07 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:07.904706 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:07.906434 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:07.953249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:07.965959 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83295c8-a957-4d5b-82c4-ba1a043533f8 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:07.969673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:07.970256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:07.970540 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:07.970815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:07.980818 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:07.982302 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:07.992296 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1439/2840] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:07 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:08.068741 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:08.079051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d22883-43b7-4cb5-b047-a9c08bd07242 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:08.082615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:08.083734 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:08.084007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:08.084277 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:08.123722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:08.151773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:08.153222 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874ff596-4d56-4b84-b010-7a77f5c265de service cinder] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:08.162716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1402/2841] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:08 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:12.247358 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:12.311813 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e55785-c3db-4d44-8001-f3455c9755e0 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:12.316387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:12.317015 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:12.317297 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:12.317572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] PATH_INFO: `/v3/users/f21941bd35274496ae2dc0688b6ecad0` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:12.318719 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21941bd35274496ae2dc0688b6ecad0)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:12.321124 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:12.368893 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21941bd35274496ae2dc0688b6ecad0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.376108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21941bd35274496ae2dc0688b6ecad0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.376940 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21941bd35274496ae2dc0688b6ecad0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.389763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21941bd35274496ae2dc0688b6ecad0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.396582 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21941bd35274496ae2dc0688b6ecad0'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.403349 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1440/2842] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:12 2022] DELETE /identity/v3/users/f21941bd35274496ae2dc0688b6ecad0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:12.407840 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:12.408393 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:12.408500 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:12.428588 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:12.429799 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:12.489666 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1403/2843] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:12.499784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:12.501249 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:12.561997 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e350f8d-6c96-4aec-910a-e513cd62ae82 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:12.565653 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:12.566315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:12.566616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:12.566892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:12.579469 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:12.580923 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:12.590367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1441/2844] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:12.862014 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:12.863557 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:12.876681 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad82ea6b-5c89-4ac2-a72c-6586a6e8aea2 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:12.881589 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:12.882182 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:12.882449 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:12.882724 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] PATH_INFO: `/v3/projects/df683b14d2b34f4f87036f8083660141` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:12.884186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=df683b14d2b34f4f87036f8083660141)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:12.886136 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:12.934070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df683b14d2b34f4f87036f8083660141', 'request_id': 'req-1c877f19-1696-4c0c-914e-59cf8c05c5fc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.941541 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df683b14d2b34f4f87036f8083660141', 'request_id': 'req-1c877f19-1696-4c0c-914e-59cf8c05c5fc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.947365 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df683b14d2b34f4f87036f8083660141', 'request_id': 'req-1c877f19-1696-4c0c-914e-59cf8c05c5fc'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.959043 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] The token cache is being invalidate because project df683b14d2b34f4f87036f8083660141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:12.959418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.960147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:12.961822 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1404/2845] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:12 2022] DELETE /identity/v3/projects/df683b14d2b34f4f87036f8083660141 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:12.966996 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:12.978309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a8422-09d7-45c7-858c-da4b747146be service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:12.983295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:13.038169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.038821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.039634 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.039913 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] PATH_INFO: `/v3/users/1fc04c09dde54c339911707b0eaa748a` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.041053 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc04c09dde54c339911707b0eaa748a)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.043017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.090140 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc04c09dde54c339911707b0eaa748a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.097392 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc04c09dde54c339911707b0eaa748a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.098033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc04c09dde54c339911707b0eaa748a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.110624 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc04c09dde54c339911707b0eaa748a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.118262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-52fd84b5-1e94-4612-a4f6-f3fcc2fdef61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc04c09dde54c339911707b0eaa748a'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.124252 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1442/2846] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:12 2022] DELETE /identity/v3/users/1fc04c09dde54c339911707b0eaa748a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:13.407680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.409141 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:13.422157 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c877f19-1696-4c0c-914e-59cf8c05c5fc admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.475922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:13.482776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.483422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.484175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.484516 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] PATH_INFO: `/v3/projects/7ce27f2b1ba1462b80338977954b50ee` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.485712 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce27f2b1ba1462b80338977954b50ee)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.488413 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.537646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce27f2b1ba1462b80338977954b50ee', 'request_id': 'req-050da8a7-36b2-49fe-bed4-7ab77f34d146'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.545236 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce27f2b1ba1462b80338977954b50ee', 'request_id': 'req-050da8a7-36b2-49fe-bed4-7ab77f34d146'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.550957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce27f2b1ba1462b80338977954b50ee', 'request_id': 'req-050da8a7-36b2-49fe-bed4-7ab77f34d146'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.562754 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] The token cache is being invalidate because project 7ce27f2b1ba1462b80338977954b50ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:13.563049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.563711 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-050da8a7-36b2-49fe-bed4-7ab77f34d146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:13.565216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1405/2847] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:13 2022] DELETE /identity/v3/projects/7ce27f2b1ba1462b80338977954b50ee => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:13.570255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.572030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.572310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.592042 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:13.593267 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:13.669199 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1443/2848] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:13.671520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.671813 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.672257 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.692894 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:13.694178 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:13.702154 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1406/2849] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:13.706340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.716368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa42e83-9e5f-4711-af60-f0cfb749ff5e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.721127 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.721743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.722289 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.722572 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] PATH_INFO: `/v3/domains` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.723435 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81453) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:13.723577 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.725283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.737850 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1444/2850] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:13.742101 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.753510 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b559c7-2d10-4360-b175-c84f228dd6e1 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.758957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.759176 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.759456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.759726 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.760358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.762266 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.795103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1407/2851] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:13 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:13.796648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.808788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a626a73-899c-45c7-956a-9f0eaf358aba admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.821147 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:13.871538 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.872071 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.872350 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.872625 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.873258 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.875204 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.902809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1445/2852] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:13 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:13.904098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.915853 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ed184-8e0c-450a-ad16-649f6cb8142d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.920746 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.921367 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.921648 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.921959 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.922611 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.924208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.938165 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1408/2853] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:01:13.939432 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.949636 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15209e93-7d74-42bd-92be-9f2ef9d5686d admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.954271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.954869 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.955151 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.955426 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:13.956107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:13.957769 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeebc2b-83d7-4b12-acea-fcd2f6516b6a admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:13.969714 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1446/2854] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:13.973783 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:13.984146 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff247005-e767-4b9d-81b2-c75181c1e9b8 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:13.989098 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:13.989725 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:13.990049 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:13.990315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] PATH_INFO: `/v3/projects/b4877a15bc4842bd87890587651ca689/users/4b37dc8843b0403ab092f107552759cf/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.005438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4877a15bc4842bd87890587651ca689, user_id=4b37dc8843b0403ab092f107552759cf, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.008572 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.032430 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1409/2855] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:13 2022] PUT /identity/v3/projects/b4877a15bc4842bd87890587651ca689/users/4b37dc8843b0403ab092f107552759cf/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:14.043107 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.043412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.043679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.073810 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] MFA Rules not processed for user `4b37dc8843b0403ab092f107552759cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:14.075094 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:14.144021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1447/2856] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:14.149065 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.218151 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c9a41-e64c-4be8-89ef-ddb456e0c6de admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.226311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.227680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.228124 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.228319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.228975 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.230989 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.262983 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1410/2857] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:14 2022] POST /identity/v3/projects => generated 389 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:14.268215 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.285260 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb64933-e528-4e6c-b83b-10beb5875a4e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.350062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.350679 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.350965 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.351244 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] PATH_INFO: `/v3/users` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.352033 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.354077 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.378492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1448/2858] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:14 2022] POST /identity/v3/users => generated 301 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:14.380050 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.395715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee7d6-8786-4d3f-9f05-e360c45f6ecf admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.401230 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.402028 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.402317 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.402635 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.403532 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.405128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.408422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:14.425717 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1411/2859] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:14.429846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.446162 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63021df-f0df-4ef3-bc61-e849c0e9e670 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.451056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.452069 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.452529 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.452880 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] PATH_INFO: `/v3/projects/899dc04efd5247a296ea81917975d141/users/c6975e50c6f64068955d32fba004cc38/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.469292 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:14.475468 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899dc04efd5247a296ea81917975d141, user_id=c6975e50c6f64068955d32fba004cc38, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.478783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.496108 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1449/2860] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:14 2022] PUT /identity/v3/projects/899dc04efd5247a296ea81917975d141/users/c6975e50c6f64068955d32fba004cc38/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:14.507372 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.519758 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1149ee-35c9-406d-b8b4-b37b0b15b63d admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.583546 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.584172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.584458 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.584767 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.585445 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.587679 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1691a5c-5c96-4ca4-a865-240792e9cc52 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.597730 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1412/2861] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:14.602709 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.613172 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eecfd71-771c-4fcc-aa80-a02864f4a652 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.618090 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.618744 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.619027 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.619304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] PATH_INFO: `/v3/projects/899dc04efd5247a296ea81917975d141/users/c6975e50c6f64068955d32fba004cc38/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.621217 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=899dc04efd5247a296ea81917975d141, user_id=c6975e50c6f64068955d32fba004cc38, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.624046 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.635642 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1450/2862] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:14 2022] PUT /identity/v3/projects/899dc04efd5247a296ea81917975d141/users/c6975e50c6f64068955d32fba004cc38/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 02:01:14.705456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.705748 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.706107 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.738077 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] MFA Rules not processed for user `c6975e50c6f64068955d32fba004cc38`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:14.739585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:14.814035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1413/2863] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:14.825803 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:14.827776 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:14.892777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20578dd0-51f0-45f6-accf-74f1beba65c6 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:14.896874 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:14.897887 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:14.898173 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:14.898528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:14.908506 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:14.909973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d429e8-dfad-4b1b-9da6-68ea3ccd8952 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:14.921254 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1451/2864] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:14 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:15.066431 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:15.143842 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846ee2-6be8-476a-812c-61c79ea46715 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:15.148685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:15.149327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:15.149609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:15.149901 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] PATH_INFO: `/v3/users/4b37dc8843b0403ab092f107552759cf` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:15.151035 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b37dc8843b0403ab092f107552759cf)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:15.153067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:15.177531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:15.206111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b37dc8843b0403ab092f107552759cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.213722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b37dc8843b0403ab092f107552759cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.227337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b37dc8843b0403ab092f107552759cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.228051 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b37dc8843b0403ab092f107552759cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.234833 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b37dc8843b0403ab092f107552759cf'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.241422 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1414/2865] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:15 2022] DELETE /identity/v3/users/4b37dc8843b0403ab092f107552759cf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:15.246488 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:15.246778 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:15.247057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:15.266128 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:15.267248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:15.326823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1452/2866] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:15.336773 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:15.338385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:15.395465 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96e294-9631-45f4-ad28-d8432cb5be96 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:15.399224 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:15.399834 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:15.400115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:15.400390 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:15.409395 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:15.410852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:15.421226 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1415/2867] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:15.758092 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:15.759815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:15.774631 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf1a4e-8001-480f-a213-393deac8ddae None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:15.780099 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:15.780751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:15.781032 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:15.781304 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] PATH_INFO: `/v3/projects/b4877a15bc4842bd87890587651ca689` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:15.782614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4877a15bc4842bd87890587651ca689)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:15.786137 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:15.844620 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4877a15bc4842bd87890587651ca689', 'request_id': 'req-097425ba-250d-4221-b56e-f308a513ad65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.852614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4877a15bc4842bd87890587651ca689', 'request_id': 'req-097425ba-250d-4221-b56e-f308a513ad65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.859542 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4877a15bc4842bd87890587651ca689', 'request_id': 'req-097425ba-250d-4221-b56e-f308a513ad65'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.871475 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] The token cache is being invalidate because project b4877a15bc4842bd87890587651ca689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:15.871773 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.872442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:15.873962 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1453/2868] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:15 2022] DELETE /identity/v3/projects/b4877a15bc4842bd87890587651ca689 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 02:01:15.878080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:15.888654 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a0be-cdc1-44bb-a875-90800a8f44ec service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:15.961891 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:15.962615 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:15.962915 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:15.963213 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] PATH_INFO: `/v3/users/c6975e50c6f64068955d32fba004cc38` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:15.964376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6975e50c6f64068955d32fba004cc38)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:15.967242 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:16.023434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:16.027760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6975e50c6f64068955d32fba004cc38'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.039847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6975e50c6f64068955d32fba004cc38'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.056340 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6975e50c6f64068955d32fba004cc38'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.057119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6975e50c6f64068955d32fba004cc38'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.066883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a084a5f-1bce-4043-a530-da76bd9248ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6975e50c6f64068955d32fba004cc38'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.080955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1416/2869] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:15 2022] DELETE /identity/v3/users/c6975e50c6f64068955d32fba004cc38 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:16.496360 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:16.498021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:16.506187 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:16.514100 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097425ba-250d-4221-b56e-f308a513ad65 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:16.582180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:16.582827 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:16.583113 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:16.583387 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] PATH_INFO: `/v3/projects/899dc04efd5247a296ea81917975d141` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:16.584686 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=899dc04efd5247a296ea81917975d141)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:16.586743 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:16.639458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '899dc04efd5247a296ea81917975d141', 'request_id': 'req-737ed578-137d-4861-a669-7f18b92c9188'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.649616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '899dc04efd5247a296ea81917975d141', 'request_id': 'req-737ed578-137d-4861-a669-7f18b92c9188'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.656301 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '899dc04efd5247a296ea81917975d141', 'request_id': 'req-737ed578-137d-4861-a669-7f18b92c9188'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.674886 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] The token cache is being invalidate because project 899dc04efd5247a296ea81917975d141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:16.675261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.675990 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-737ed578-137d-4861-a669-7f18b92c9188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:16.677765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1454/2870] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:16 2022] DELETE /identity/v3/projects/899dc04efd5247a296ea81917975d141 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:16.683321 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:16.683716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:16.684216 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:16.708223 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:16.709518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:16.900622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1417/2871] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:01:16.908422 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:16.908930 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:16.909040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:16.931146 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:16.932474 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:16.941632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1455/2872] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:01:16.945761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:16.956363 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa38454-e4ab-4c57-ba51-46a62137548f None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:16.963278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:16.964004 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:16.964399 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:16.964745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:16.965456 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:16.965826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:16.967527 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:16.982839 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1418/2873] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:16.987268 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:16.996983 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc50ee-6a9f-46ab-9c5a-262cf3739e4a None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.002699 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.003311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.003592 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.003864 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.004503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.006453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.037702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1456/2874] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:16 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:17.042689 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:17.057082 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca055-b77d-4077-9205-5033998ac7be admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.133515 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.134335 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.134686 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.135026 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.135737 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.137802 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.167374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1419/2875] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:17 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:17.168002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:17.185559 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54274147-533b-4b98-87d0-8820a001fe74 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.191261 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.192000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.192286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.192558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.193234 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.195167 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.208750 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1457/2876] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:17.210207 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:17.227041 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6186b-7ae2-4f21-9cf9-0ff8919128e1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.235542 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.236200 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.236479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.236749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.237451 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.239594 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b906-abca-4c41-a142-ceba8b6978a1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.255924 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1420/2877] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 16 02:01:17.257117 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:17.286831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c8258-90ab-432c-afab-9bcceea1ddaf admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.292675 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.293551 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.293784 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.294103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] PATH_INFO: `/v3/projects/37d33d2935cd4496a7b6a141974201eb/users/9b7f7237ed904237ae487109750e1e9d/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.324770 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37d33d2935cd4496a7b6a141974201eb, user_id=9b7f7237ed904237ae487109750e1e9d, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.327712 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.348605 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1458/2878] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:17 2022] PUT /identity/v3/projects/37d33d2935cd4496a7b6a141974201eb/users/9b7f7237ed904237ae487109750e1e9d/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:17.350296 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164feb-267f-4484-9e9f-14db487dfd6d None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.350582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164feb-267f-4484-9e9f-14db487dfd6d None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.350852 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9164feb-267f-4484-9e9f-14db487dfd6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.369479 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f9164feb-267f-4484-9e9f-14db487dfd6d None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:17.370710 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f9164feb-267f-4484-9e9f-14db487dfd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:17.391608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:17.442961 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1421/2879] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:17.455544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:17.458111 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:17.495964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:17.530074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da12c3-09e8-4b00-9977-b28090b1bed4 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:17.533687 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:17.534322 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:17.534602 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:17.534922 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:17.544194 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:17.545546 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:17.555248 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1459/2880] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:18.189506 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.190113 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.190232 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.220002 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] MFA Rules not processed for user `9b7f7237ed904237ae487109750e1e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:18.221379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:18.296184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1422/2881] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:18.300793 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.312093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcacdff9-baaf-4651-ad60-edc16255fd8a service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.317839 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.318674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.319327 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.319777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.321393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.323544 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.359118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1460/2882] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:18 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:18.361377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.373602 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db126e-f8f6-4d1d-a2e0-099d74674406 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.436149 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.436763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.437040 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.437459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.438130 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.440184 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.467231 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1423/2883] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:18 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:18.471404 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.481701 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97596b2c-de0f-4e5d-a4eb-3a01ce7087f5 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.486334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.486938 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.487223 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.487503 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.488148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.489738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.500951 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1461/2884] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:18.505684 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.517776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2512fb1-ba79-452f-a296-19427c59e818 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.523238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.523935 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.524218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.524495 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] PATH_INFO: `/v3/projects/068c7b50b8e04944b5dea833828680c1/users/8126f1ef187640108726369436267c54/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.539387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068c7b50b8e04944b5dea833828680c1, user_id=8126f1ef187640108726369436267c54, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.542145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.556332 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1424/2885] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:18 2022] PUT /identity/v3/projects/068c7b50b8e04944b5dea833828680c1/users/8126f1ef187640108726369436267c54/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:18.560467 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.572308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4e68c-516d-453b-ac2c-ad960ea946df admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.627924 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.628454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.628732 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.629002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.629629 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.631232 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2544ea7-90f0-4123-8781-d34cc99b1cfe admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.641411 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1462/2886] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:18.645692 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:18.655871 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18587c27-7f32-47a5-8936-4251328a91e4 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:18.660509 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:18.661161 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] REQUEST_METHOD: `PUT` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:18.661438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:18.661709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] PATH_INFO: `/v3/projects/068c7b50b8e04944b5dea833828680c1/users/8126f1ef187640108726369436267c54/roles/1e8d49b29f0b4d74819627a73b17767f` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:18.663672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] RBAC: Authorizing `identity:create_grant(project_id=068c7b50b8e04944b5dea833828680c1, user_id=8126f1ef187640108726369436267c54, role_id=1e8d49b29f0b4d74819627a73b17767f)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:18.666351 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb5ca2-f822-4ac2-ac33-4e326038396b admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:18.676387 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1425/2887] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:18 2022] PUT /identity/v3/projects/068c7b50b8e04944b5dea833828680c1/users/8126f1ef187640108726369436267c54/roles/1e8d49b29f0b4d74819627a73b17767f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:19.449535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:19.450059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:19.450160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:19.479388 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] MFA Rules not processed for user `8126f1ef187640108726369436267c54`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:19.480616 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:19.598848 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1463/2888] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:19.609218 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a389-25f7-4f2a-8207-e142530347c8 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:19.609747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a389-25f7-4f2a-8207-e142530347c8 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:19.609747 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2a389-25f7-4f2a-8207-e142530347c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:19.631848 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-caf2a389-25f7-4f2a-8207-e142530347c8 None None] MFA Rules not processed for user `9b7f7237ed904237ae487109750e1e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:19.633186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-caf2a389-25f7-4f2a-8207-e142530347c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:19.638401 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:19.699032 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1426/2889] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:19.711334 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:19.712792 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:19.747861 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:19.805449 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95786e7-9e51-4375-9d02-38d80094fa83 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:19.811160 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:19.811779 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:19.812057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:19.812325 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:19.821025 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:19.823637 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:19.832635 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1464/2890] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:20.591976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108651-a738-44e3-a74c-adb8979f9302 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:20.592376 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108651-a738-44e3-a74c-adb8979f9302 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:20.592728 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6108651-a738-44e3-a74c-adb8979f9302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:20.614273 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-d6108651-a738-44e3-a74c-adb8979f9302 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:20.615474 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-d6108651-a738-44e3-a74c-adb8979f9302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:20.678518 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1427/2891] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:20.693354 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:20.705141 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749c88f-2897-447d-a7ac-5454d2dfd9f8 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:20.711016 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:20.711821 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:20.712228 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:20.712567 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:20.721118 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:20.722749 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:20.732969 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1465/2892] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:23.673197 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:23.674135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:23.674411 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:23.694038 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:23.695238 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:23.703780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1428/2893] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:23.718311 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:23.730319 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7e90c-f83b-4678-923e-4531fd1bfd70 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:23.736230 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:23.736835 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:23.737120 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:23.737393 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:23.746250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:23.747815 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b285dba-9321-45bd-b45c-cfad73a09ced service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:23.757221 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1466/2894] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:24.745067 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:24.746614 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:24.802769 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6279a992-f014-423e-8f03-18b70237e1e4 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:24.806281 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:24.806883 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:24.807162 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:24.807433 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:24.809156 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:24.869678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:24.871152 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:24.875145 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=100 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:24.882103 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1429/2895] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:24 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:26.981159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cecab-877c-4f26-b8cd-3dbbddb574b6 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:26.981733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cecab-877c-4f26-b8cd-3dbbddb574b6 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:26.981733 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161cecab-877c-4f26-b8cd-3dbbddb574b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:27.001558 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-161cecab-877c-4f26-b8cd-3dbbddb574b6 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:27.002798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-161cecab-877c-4f26-b8cd-3dbbddb574b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:27.010973 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1467/2896] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:27.029764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:27.031240 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:27.047071 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1fee-7b14-4776-aa39-23dff4c33e68 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:27.052396 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:27.052992 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:27.053271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:27.053538 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:27.061563 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:27.063148 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:27.074295 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1430/2897] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:30.084250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f1f9-b90c-4e27-b0f5-9e914a67e5a4 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:30.085283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f1f9-b90c-4e27-b0f5-9e914a67e5a4 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:30.085283 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c80f1f9-b90c-4e27-b0f5-9e914a67e5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:30.106726 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-7c80f1f9-b90c-4e27-b0f5-9e914a67e5a4 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:30.108135 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-7c80f1f9-b90c-4e27-b0f5-9e914a67e5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:30.116939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1468/2898] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:30.131780 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:30.143881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb01a6-b683-4637-b6c5-d4a8fae702cd service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:30.149565 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:30.150771 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:30.151048 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:30.151324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:30.161042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:30.162680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:30.174987 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1431/2899] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:33.318826 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:33.319298 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:33.319414 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:33.342062 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:33.343453 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:33.353949 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1469/2900] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:33.382342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:33.394784 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d154fb1-f011-4ee6-94ed-e2ee2677e290 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:33.400210 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:33.400801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:33.401128 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:33.401348 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:33.409262 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:33.410849 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862fbf0-02b3-4bd6-a324-b25b24e7817d service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:33.420520 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1432/2901] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:34.418250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:34.419623 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:34.476619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c22281-4dc8-4710-a26d-6f1cc5e852d8 None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:34.480271 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:34.480875 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:34.481184 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:34.481461 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:34.490253 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:34.491677 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:34.501191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1470/2902] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:36.425247 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1257e-a385-47cf-969b-bc49fd3883d3 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:36.425794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1257e-a385-47cf-969b-bc49fd3883d3 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:36.425794 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1257e-a385-47cf-969b-bc49fd3883d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:36.445967 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-6aa1257e-a385-47cf-969b-bc49fd3883d3 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:36.447185 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6aa1257e-a385-47cf-969b-bc49fd3883d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:36.455209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1433/2903] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:36.470831 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:36.483953 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b498-10ce-42e4-9015-2672de6b2563 service cinder] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:36.489270 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:36.489859 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:36.490180 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:36.490454 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:36.499000 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:36.500561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:36.509993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1471/2904] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:46.440702 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=22 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:46.505607 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=78 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:53.664585 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:53.665180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:53.665180 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:53.707311 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] MFA Rules not processed for user `e5912b2f23fe4a0489cbd28eacc9a7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:53.708571 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:53.780661 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1434/2905] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:54.843786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:54.845191 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:54.905722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:54.907438 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:54.986715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab16f78-8e80-4c77-917d-105b2738dcf6 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:54.987843 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbeb2f-0fd3-4a2c-aace-ded53e8aebd3 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:54.991720 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:54.992327 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:54.992609 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:54.992828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:54.992978 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:54.993403 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:54.993683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:54.993989 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:54.994861 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:54.996198 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:55.006786 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:55.007948 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:55.008632 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:55.009763 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:55.019135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1435/2906] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 02:01:55.020472 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1472/2907] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:56.984699 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:57.018264 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd2f35-0f0c-4da3-a187-8b256727560b service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:57.022845 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:57.023477 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:57.023760 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:57.024060 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] PATH_INFO: `/v3/users/9b7f7237ed904237ae487109750e1e9d` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:57.025187 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b7f7237ed904237ae487109750e1e9d)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:57.027385 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:57.071470 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:57.083531 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b7f7237ed904237ae487109750e1e9d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.092626 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b7f7237ed904237ae487109750e1e9d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.106973 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b7f7237ed904237ae487109750e1e9d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.107722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b7f7237ed904237ae487109750e1e9d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.114493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b7f7237ed904237ae487109750e1e9d'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.120922 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1436/2908] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:56 2022] DELETE /identity/v3/users/9b7f7237ed904237ae487109750e1e9d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:57.298397 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:57.311729 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3841db6-fa25-4986-9ed0-83b7eec0cf6e service placement] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:57.376847 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:57.377489 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:57.377777 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:57.378089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] PATH_INFO: `/v3/projects/37d33d2935cd4496a7b6a141974201eb` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:57.379224 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37d33d2935cd4496a7b6a141974201eb)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:57.381136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:57.418751 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:57.431927 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37d33d2935cd4496a7b6a141974201eb', 'request_id': 'req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.440674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37d33d2935cd4496a7b6a141974201eb', 'request_id': 'req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.447004 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37d33d2935cd4496a7b6a141974201eb', 'request_id': 'req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.471515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] The token cache is being invalidate because project 37d33d2935cd4496a7b6a141974201eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:57.471737 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.472366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.474089 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1473/2909] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:57 2022] DELETE /identity/v3/projects/37d33d2935cd4496a7b6a141974201eb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:57.477761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:57.479192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:57.493115 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a012c10-d157-4ea9-93f3-4a6e9162d067 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:57.553574 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:57.554249 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:57.554525 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:57.554800 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] PATH_INFO: `/v3/users/8126f1ef187640108726369436267c54` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:57.555942 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8126f1ef187640108726369436267c54)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:57.558455 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:57.624022 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8126f1ef187640108726369436267c54'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.635088 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8126f1ef187640108726369436267c54'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.648939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8126f1ef187640108726369436267c54'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.649643 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8126f1ef187640108726369436267c54'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.658847 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-55782c84-b45c-4914-9725-fc1b68ff9cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8126f1ef187640108726369436267c54'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.665083 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1437/2910] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:57 2022] DELETE /identity/v3/users/8126f1ef187640108726369436267c54 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:57.834476 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:57.836054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:57.860725 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25cdfd-bc7b-4b6d-83d7-3887449cbbc9 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:57.929921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:57.930561 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:57.930846 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:57.931121 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] PATH_INFO: `/v3/projects/068c7b50b8e04944b5dea833828680c1` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:57.932239 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068c7b50b8e04944b5dea833828680c1)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:57.934269 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:57.980933 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068c7b50b8e04944b5dea833828680c1', 'request_id': 'req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.988528 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068c7b50b8e04944b5dea833828680c1', 'request_id': 'req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:57.994143 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068c7b50b8e04944b5dea833828680c1', 'request_id': 'req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.007054 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] The token cache is being invalidate because project 068c7b50b8e04944b5dea833828680c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:58.007427 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.008086 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-3e6399fc-f6aa-42c6-9fa7-9c611f97d728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.010579 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1474/2911] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:57 2022] DELETE /identity/v3/projects/068c7b50b8e04944b5dea833828680c1 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 16 02:01:58.015309 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.015890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.015890 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.069722 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:58.079007 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:58.080667 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:58.138493 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1438/2912] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:58.146207 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.146492 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.146765 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.166074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:58.167789 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:58.175484 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1475/2913] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 16 02:01:58.179698 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.189244 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bedc5-9bd5-452b-aac2-5fb7aace02fa None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.193703 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.194328 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.194608 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.194881 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.195522 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81454) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 16 02:01:58.195826 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.197407 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.209119 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1439/2914] 10.222.0.33 () {58 vars in 1153 bytes} [Fri Sep 16 02:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 16 02:01:58.213185 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.222783 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75be0e-abde-4e13-97c1-6df357caedce None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.227341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.228169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.228452 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.229014 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.229369 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.231332 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.262462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1476/2915] 10.222.0.33 () {60 vars in 1153 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 16 02:01:58.263672 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.273763 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7626a7b1-5f46-4408-be6e-a018053fbd07 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.328497 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.329094 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.329374 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.329646 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] PATH_INFO: `/v3/users` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.330315 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.332212 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.353567 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1440/2916] 10.222.0.33 () {60 vars in 1144 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 16 02:01:58.357702 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.367909 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b6c7a2-5185-434a-82cc-105043003344 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.372515 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.373101 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.373379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.373648 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] PATH_INFO: `/v3/roles` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.374321 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.375884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.380928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:58.387681 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1477/2917] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:58.390789 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.400540 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ddbed-5510-48dc-a51d-a90c22931db1 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.405640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.406256 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.406535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.406807 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.407437 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.409008 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdd942-ea60-4747-a2e1-0bd262ebdad1 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.419618 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1441/2918] 10.222.0.33 () {58 vars in 1122 bytes} [Fri Sep 16 02:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 16 02:01:58.423798 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.434368 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f378198-9e36-4dc1-a42f-acc5c33eb74b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.438955 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.439596 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.439884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.440165 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] PATH_INFO: `/v3/projects/79c7757ab5a84afca04cbf7d3bf2a742/users/0b1f9a79be2445dda7a7b14d65e68070/roles/1620c8d7a29041378a32461a8cde3643` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.455262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79c7757ab5a84afca04cbf7d3bf2a742, user_id=0b1f9a79be2445dda7a7b14d65e68070, role_id=1620c8d7a29041378a32461a8cde3643)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.457939 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.472057 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1478/2919] 10.222.0.33 () {60 vars in 1483 bytes} [Fri Sep 16 02:01:58 2022] PUT /identity/v3/projects/79c7757ab5a84afca04cbf7d3bf2a742/users/0b1f9a79be2445dda7a7b14d65e68070/roles/1620c8d7a29041378a32461a8cde3643 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:58.482353 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.482610 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.482910 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.510308 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] MFA Rules not processed for user `0b1f9a79be2445dda7a7b14d65e68070`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:58.512111 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:58.570976 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:58.575855 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1442/2920] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:58.586399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.588104 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:58.644295 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101f0526-374e-431f-9bcc-01580b41ad48 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.647921 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '08454b4a2236492b9adacd16cfeec4e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.648511 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.648788 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.649059 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.657159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.658583 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34b7a0-8863-42cd-9f8f-7951e4a46019 service cinder] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.667055 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1479/2921] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:58.690209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.750856 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c7c86f-6610-425f-ae00-529189a53598 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:58.755554 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:58.756186 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.756467 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.756745 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] PATH_INFO: `/v3/users/0b1f9a79be2445dda7a7b14d65e68070` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.757895 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b1f9a79be2445dda7a7b14d65e68070)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:58.760091 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:58.807537 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b1f9a79be2445dda7a7b14d65e68070'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.814036 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b1f9a79be2445dda7a7b14d65e68070'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.826446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b1f9a79be2445dda7a7b14d65e68070'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.827143 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b1f9a79be2445dda7a7b14d65e68070'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.835059 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b1f9a79be2445dda7a7b14d65e68070'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:58.841642 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1443/2922] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:01:58 2022] DELETE /identity/v3/users/0b1f9a79be2445dda7a7b14d65e68070 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:01:58.846458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] REQUEST_METHOD: `POST` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:58.846747 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:58.847022 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:58.869037 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.auth.core [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81453) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:01:58.870436 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:58.939183 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1480/2923] 10.222.0.33 () {58 vars in 958 bytes} [Fri Sep 16 02:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:01:58.968902 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:58.970409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:59.042577 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1345dd86-f349-4ec4-ad73-1df2b9f7030e admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:59.046616 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:59.047228 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:59.047543 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:59.047816 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:59.057624 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:59.058969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b7cc9d-dab0-499d-97bd-cf8d10a4564d service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:59.069358 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1444/2924] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:01:59.355158 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:01:59.356580 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:01:59.368372 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0301c87-7b72-4b4a-85a8-9052e2b19c8e None None] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:01:59.374361 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:01:59.375103 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:01:59.375458 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:01:59.375800 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] PATH_INFO: `/v3/projects/79c7757ab5a84afca04cbf7d3bf2a742` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:01:59.377002 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=79c7757ab5a84afca04cbf7d3bf2a742)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:01:59.379065 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:01:59.425333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79c7757ab5a84afca04cbf7d3bf2a742', 'request_id': 'req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:59.434109 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79c7757ab5a84afca04cbf7d3bf2a742', 'request_id': 'req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:59.439780 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79c7757ab5a84afca04cbf7d3bf2a742', 'request_id': 'req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:59.451342 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] The token cache is being invalidate because project 79c7757ab5a84afca04cbf7d3bf2a742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:01:59.451632 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:59.452256 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:01:59.453742 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1481/2925] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:01:59 2022] DELETE /identity/v3/projects/79c7757ab5a84afca04cbf7d3bf2a742 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:02:06.556215 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1750-4e87-4986-b6cf-6bf1c837c4ae None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:06.556801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1750-4e87-4986-b6cf-6bf1c837c4ae None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:06.556801 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a1750-4e87-4986-b6cf-6bf1c837c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:06.576484 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-f10a1750-4e87-4986-b6cf-6bf1c837c4ae None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:02:06.577678 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-f10a1750-4e87-4986-b6cf-6bf1c837c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:06.594658 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:06.639418 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1445/2926] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:02:06.653828 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:06.655310 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:06.659148 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:06.757738 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79ceb-5e5f-493c-8b1f-0d2323b04b2e admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:06.764129 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:06.764727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:06.765011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:06.765287 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:06.773181 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:06.774781 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:06.783986 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1482/2927] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:02:09.828814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905dc7-d820-49be-ae09-fe7466cb41e5 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:09.829355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905dc7-d820-49be-ae09-fe7466cb41e5 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:09.829355 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68905dc7-d820-49be-ae09-fe7466cb41e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:09.848885 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-68905dc7-d820-49be-ae09-fe7466cb41e5 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:02:09.850114 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-68905dc7-d820-49be-ae09-fe7466cb41e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:09.857764 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1446/2928] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:02:09.871457 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:09.873308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:09.888535 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1313ea20-3fd0-4a96-9de1-7a3d187a835d service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:09.893892 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:09.894479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:09.894760 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:09.895030 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:09.902857 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:09.904399 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:09.913524 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1483/2929] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:02:12.904709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668363-b8ba-426f-9d47-189d6048b132 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:12.905209 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668363-b8ba-426f-9d47-189d6048b132 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:12.905337 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95668363-b8ba-426f-9d47-189d6048b132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:12.924172 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-95668363-b8ba-426f-9d47-189d6048b132 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:02:12.925357 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-95668363-b8ba-426f-9d47-189d6048b132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:12.933090 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1447/2930] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:02:12.947407 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:12.959470 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a59bf-b01f-4330-835e-1bddd42bb2b1 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:12.965064 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:12.965683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:12.966009 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:12.966281 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:12.974308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:12.975884 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:12.984975 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1484/2931] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:02:16.058652 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989384-03d7-4f99-ad07-3f9618d27a6f None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:16.059709 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989384-03d7-4f99-ad07-3f9618d27a6f None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:16.059814 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989384-03d7-4f99-ad07-3f9618d27a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:16.079736 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-5b989384-03d7-4f99-ad07-3f9618d27a6f None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:02:16.080939 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-5b989384-03d7-4f99-ad07-3f9618d27a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:16.088873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1448/2932] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:02:16.105161 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:16.117017 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3aad9-710d-4a09-a512-b87b4980434c service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:16.123174 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:16.123762 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:16.124043 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:16.124315 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:16.132262 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:16.134106 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:16.143365 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1485/2933] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:02:19.220132 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] REQUEST_METHOD: `POST` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:19.220605 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:19.220716 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:19.239545 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.auth.core [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] MFA Rules not processed for user `754ee13771964e1b8b4c099c78264d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81454) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 16 02:02:19.240715 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:19.248459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1449/2934] 10.222.0.20 () {58 vars in 1016 bytes} [Fri Sep 16 02:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 16 02:02:19.266056 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:19.277382 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e508c-c54a-4511-88ad-868ed8f9c696 service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:19.283541 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:19.284136 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:19.284416 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:19.284690 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:19.292703 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:19.294308 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:19.303495 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1486/2935] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:02:29.234838 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=29 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:29.299370 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=69 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:47.273342 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:47.274827 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:02:47.289558 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef84fbe-7c2d-4c84-96eb-936c4939b750 None None] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:47.294304 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:47.294931 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:47.295208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:47.295480 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] PATH_INFO: `/v3/users/e5912b2f23fe4a0489cbd28eacc9a7ba` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:47.296631 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5912b2f23fe4a0489cbd28eacc9a7ba)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:47.298592 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:47.344379 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5912b2f23fe4a0489cbd28eacc9a7ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.351219 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5912b2f23fe4a0489cbd28eacc9a7ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.363944 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5912b2f23fe4a0489cbd28eacc9a7ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.364622 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5912b2f23fe4a0489cbd28eacc9a7ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.371359 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5912b2f23fe4a0489cbd28eacc9a7ba'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.377070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1450/2936] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:02:47 2022] DELETE /identity/v3/users/e5912b2f23fe4a0489cbd28eacc9a7ba => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:02:47.542200 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:02:47.552333 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff7450-cf0c-4138-a090-07545958d17e service nova] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:02:47.613195 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:02:47.613753 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:02:47.614066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:02:47.614341 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] PATH_INFO: `/v3/projects/c6e3c94a8ad14556b8d0471f9dd4c4e7` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:02:47.615462 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e3c94a8ad14556b8d0471f9dd4c4e7)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:02:47.617356 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:02:47.661837 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e3c94a8ad14556b8d0471f9dd4c4e7', 'request_id': 'req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.668479 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e3c94a8ad14556b8d0471f9dd4c4e7', 'request_id': 'req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.673979 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e3c94a8ad14556b8d0471f9dd4c4e7', 'request_id': 'req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.685674 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] The token cache is being invalidate because project c6e3c94a8ad14556b8d0471f9dd4c4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81453) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:02:47.685993 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.686641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:02:47.688093 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1487/2937] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:02:47 2022] DELETE /identity/v3/projects/c6e3c94a8ad14556b8d0471f9dd4c4e7 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:02:57.373640 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:57.682786 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:38.016459 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:03:38.017955 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:03:38.098386 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fa8802-1b74-4adc-896b-c5324e8f9175 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:03:38.147135 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:03:38.147742 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:03:38.148023 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:03:38.148298 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:03:38.150070 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:03:38.159338 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:03:38.160761 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:03:38.169078 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1451/2938] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:03:38.240610 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:03:38.242036 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:03:38.254139 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee48a1c-8f63-4c2c-9195-c81001edcb1b admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:03:38.258021 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:03:38.258619 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:03:38.258899 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:03:38.259169 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:03:38.260809 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:03:38.332823 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:03:38.334791 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:03:38.345493 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1488/2939] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:03:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:03:40.392434 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:03:40.403787 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0da0d2-cafb-427b-b0b8-c1a457eee7d6 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:03:40.407323 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:03:40.407917 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:03:40.408192 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:03:40.408462 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:03:40.410175 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:03:40.423006 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:03:40.424409 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:03:40.435271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1452/2940] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:03:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:03:48.340728 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=34 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:50.430271 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=61 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:48.591125 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:04:48.592565 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:48.603366 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883750b-5fe2-4c52-a036-18b2ed1f3c68 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:04:48.607003 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:04:48.607711 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:04:48.608007 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:04:48.608282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:04:48.610282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:48.619845 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:04:48.621250 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:04:48.629340 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1489/2941] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:04:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 02:04:53.396147 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:04:53.398126 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:53.421524 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5e8b9-e342-456b-b383-4543a2d88530 service neutron] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:04:53.427595 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:04:53.428324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:04:53.428671 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:04:53.428951 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:04:53.430957 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:53.443749 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:04:53.446075 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:04:53.457691 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1453/2942] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:04:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:04:54.769336 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:04:54.778309 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47393157-d694-44df-b47f-5a6138af02ce service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:04:54.781964 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3e762164ac406bbdd85ff1185c53c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:04:54.782571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:04:54.782853 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:04:54.783130 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:04:54.784834 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:54.798367 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:04:54.799723 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:04:54.810994 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1490/2943] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:04:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:04:55.748523 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:04:55.760204 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab88b89e-2479-4c7d-8826-d77286e8bbb5 service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:04:55.766441 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6e5607c5bb0f43cc9e79e6e0351077a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:04:55.767225 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:04:55.767446 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:04:55.767721 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:04:55.769619 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:04:55.783591 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:04:55.785171 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:04:55.796889 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1454/2944] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:04:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:05:00.237241 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:00.238775 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:00.346179 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339f012-76f5-460e-9714-49d95e1561d5 service neutron] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:00.352627 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:00.353257 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:00.353727 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:00.354040 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:00.355858 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:00.370412 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:00.372019 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:00.385245 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1491/2945] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:05:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:05:03.357469 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:03.371535 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdfbd3-f17d-4783-aa74-8739f876dafd service nova] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:03.380159 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:03.380792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] REQUEST_METHOD: `GET` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:03.381320 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:03.381653 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:03.383776 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:03.402283 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:03.410970 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:03.413087 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:03.415286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:03.424792 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1455/2946] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:05:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 16 02:05:03.492418 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a58d6-cf14-425a-9fce-60bce24c9618 service placement] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:03.497074 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:03.497707 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:03.498023 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:03.498300 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] PATH_INFO: `/v3/users/63f9964527784e82a4ce52119cbc747e` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:03.499464 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63f9964527784e82a4ce52119cbc747e)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:03.501431 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:03.547601 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63f9964527784e82a4ce52119cbc747e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.560011 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63f9964527784e82a4ce52119cbc747e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.560641 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63f9964527784e82a4ce52119cbc747e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.568442 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:03.574238 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63f9964527784e82a4ce52119cbc747e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.581928 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63f9964527784e82a4ce52119cbc747e'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.589145 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1492/2947] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:05:03 2022] DELETE /identity/v3/users/63f9964527784e82a4ce52119cbc747e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:05:03.756377 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:03.767873 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a380040-b3ab-41d9-a5b3-c839c6e253e7 service placement] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:03.824066 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:03.824714 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:03.825017 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:03.825285 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] PATH_INFO: `/v3/projects/bc90050e08ad42168795c2844e84fbd7` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:03.826529 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc90050e08ad42168795c2844e84fbd7)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:03.828452 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:03.873319 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc90050e08ad42168795c2844e84fbd7', 'request_id': 'req-9de9f51d-e3f6-417b-af78-b79ff9325915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.880461 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc90050e08ad42168795c2844e84fbd7', 'request_id': 'req-9de9f51d-e3f6-417b-af78-b79ff9325915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.886556 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc90050e08ad42168795c2844e84fbd7', 'request_id': 'req-9de9f51d-e3f6-417b-af78-b79ff9325915'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.897732 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] The token cache is being invalidate because project bc90050e08ad42168795c2844e84fbd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:05:03.898042 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.898668 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:03.900208 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1456/2948] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:05:03 2022] DELETE /identity/v3/projects/bc90050e08ad42168795c2844e84fbd7 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:05:03.904282 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:03.905683 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:03.919345 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2bcce-9fa1-41fe-a0f5-201608fd95f3 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:03.974144 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:03.975379 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:03.975761 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:03.976060 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] PATH_INFO: `/v3/users/b17c8f36247e4bfa96e465b6543714df` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:03.977286 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b17c8f36247e4bfa96e465b6543714df)` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:03.979255 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:04.024617 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b17c8f36247e4bfa96e465b6543714df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.031159 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b17c8f36247e4bfa96e465b6543714df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.031752 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b17c8f36247e4bfa96e465b6543714df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.044076 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b17c8f36247e4bfa96e465b6543714df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.050870 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.notifications [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b17c8f36247e4bfa96e465b6543714df'} {{(pid=81453) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.056673 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1493/2949] 10.222.0.33 () {58 vars in 1224 bytes} [Fri Sep 16 02:05:03 2022] DELETE /identity/v3/users/b17c8f36247e4bfa96e465b6543714df => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:05:04.226932 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Authenticating user token {{(pid=81454) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:05:04.228297 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.fernet_utils [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81454) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:05:04.243938 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de9f51d-e3f6-417b-af78-b79ff9325915 admin admin] Validating token access rules against request {{(pid=81454) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:05:04.291110 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:04.302759 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '754ee13771964e1b8b4c099c78264d4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '36f275dc1246410f9a8f5e0be2414a85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81454) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:05:04.303999 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:05:04.304278 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:05:04.304551 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] PATH_INFO: `/v3/projects/84d8697b447c42259d9535279be4c5b3` {{(pid=81454) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:05:04.305685 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d8697b447c42259d9535279be4c5b3)` {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:05:04.307612 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] RBAC: Authorization granted {{(pid=81454) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:05:04.351582 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d8697b447c42259d9535279be4c5b3', 'request_id': 'req-19582cb0-b68a-4247-8411-42003e9c1cb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.358677 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d8697b447c42259d9535279be4c5b3', 'request_id': 'req-19582cb0-b68a-4247-8411-42003e9c1cb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.364324 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d8697b447c42259d9535279be4c5b3', 'request_id': 'req-19582cb0-b68a-4247-8411-42003e9c1cb2'} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.375680 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] The token cache is being invalidate because project 84d8697b447c42259d9535279be4c5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81454) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 16 02:05:04.375969 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.376601 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG keystone.notifications [None req-19582cb0-b68a-4247-8411-42003e9c1cb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81454) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 16 02:05:04.378080 dv-cinder-849143-2-smb devstack@keystone.service[81454]: [pid: 81454|app: 0|req: 1457/2950] 10.222.0.33 () {58 vars in 1233 bytes} [Fri Sep 16 02:05:04 2022] DELETE /identity/v3/projects/84d8697b447c42259d9535279be4c5b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 16 02:05:14.053189 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=60,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:14.372757 dv-cinder-849143-2-smb devstack@keystone.service[81454]: DEBUG dbcounter [-] [81454] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81454) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:00.787066 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Authenticating user token {{(pid=81453) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 16 02:07:00.788536 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:07:00.857277 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3d0c48-6a8b-4462-a6ec-5093a50d3b53 admin admin] Validating token access rules against request {{(pid=81453) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 16 02:07:00.913665 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87b1d9cc1b0c482eae5661be121abb18', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d918f5b6b3647b3b76ae72215ad9817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81453) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 16 02:07:00.914290 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] REQUEST_METHOD: `GET` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 16 02:07:00.914571 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] SCRIPT_NAME: `/identity` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 16 02:07:00.914844 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81453) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 16 02:07:00.916574 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.fernet_utils [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81453) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 16 02:07:00.927363 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 16 02:07:00.928925 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe69ca-5ddc-4ba8-af70-8e966d864f34 service placement] RBAC: Authorization granted {{(pid=81453) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 16 02:07:00.938614 dv-cinder-849143-2-smb devstack@keystone.service[81453]: [pid: 81453|app: 0|req: 1494/2951] 10.222.0.33 () {60 vars in 1365 bytes} [Fri Sep 16 02:07:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 16 02:07:10.934465 dv-cinder-849143-2-smb devstack@keystone.service[81453]: DEBUG dbcounter [-] [81453] Writing DB stats keystone:SELECT=58 {{(pid=81453) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}